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A FACTOR ANALYSIS OF VERBAL ABILITIES* 


JOHN B. CARROLL 
MOUNT HOLYOKE COLLEGE 


A multiple-factor analysis was made of a battery of 42 tests of 
verbal abilities administered to 119 college adults. Where necessary, 
the distributions of test scores were normalized before the inter-test 
correlations were computed. Thurstone’s M (Memory or Rote Learn- 
ing) factor has been confirmed, but his V (Verbal Relations) factor 
seems to have been split into two or possibly three factors, C, J, and 
G; and his W (Word Fluency) factor has been split into two factors, 
A and E. The C factor seems to represent the richness of the indi- 
vidual’s stock of linguistic responses, and the J factor seems to in- 
volve the ability to handle semantic relationships. No satisfactory 
interpretation can as yet be made of the G factor. The A factor 
seems to correspond to the speed of association for common words 
where there is a high degree of restriction as to appropriate re- 
sponses. The E factor is described as an associational facility with 
verbal material where the only restriction is that the responses must 
be syntactically coherent. The new factors are: F, facility and 
fluency in oral speech; H, facility in attaching appropriate names or 
symbols to stimuli; and D, speed of articulatory movements. 


The purpose of the present investigation has been to explore the 
domain of speech and language behavior by means of Thurstone’s 
multiple-factor analysis (10) (13). Although the present study has 
taken as its starting point certain results of Thurstone (11) which 
bear on verbal abilities, an attempt has been made to examine as broad 
an area in this domain as possible. The study has been exploratory in 
character, and the writer has been more interested in obtaining an 
approximate delineation of the field than in answering the detailed 
problems which inevitably present themselves. No investigator has 
attempted a comprehensive examination of the field of speech and lan- 
guage abilities, although the problem of the linguistic factors in what 
is known as “intelligence” has received considerable attention. 

A major problem has been the further definition of the V (Ver- 
bal Relations) and W (Word Fleuncy) factors isolated by Thurstone 
(11) (12) (14). Although the V factor has often been specified as 
one of the clearest factors in the previous studies, tests having high 
saturations on this factor have been relatively so diversified that it 
has not been possible to make such a simple hypothesis regarding the 
nature of the factor as has been possible in the case of certain other 
factors. Regarding the verbal factor, Thurstone has committed him- 

* This paper is a condensation of the writer’s doctoral dissertation, “A Fac- 


rad pencne of Verbal Abilities,” on file at the library of the University of Min- 
esota. 
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self to stating only that “the factor is evidently characterized pri- 
marily by its reference to ideas and the meanings of words” and that 
“it is quite likely, as far as one can judge from the present data, that 
the factor V will be identified largely in terms of the verbal manipu- 
lation of ideas as they occur in sustained verbal discourse” (11, pp. 
84-85). The writer believes that it would be desirable to describe the 
verbal factor in terms of some kind of psychological process rather 
than merely in terms of the type of material with which the factor is 
associated. Furthermore, it is not certain that the interpretations of 
the verbal factor which have been advanced thus far are of sufficient 
generality. Thurstone has suggested that in order to resolve this dif- 
ficulty comparisons should be made between tests which involve the 
manipulation of ideas in verbal and in essentially nonverbal form 
(11, p. 85). Nevertheless, the writer has not been able to conceive 
tests which clearly involve ideas in nonverbal form, with the possible 
exception of a syllogism test utilizing Euler’s circles. It might be pos- 
sible to construct a verbal analogies test or even a vocabulary test in 
pictorial form, but even if this were done there would remain the pos- 
sibility that the solution of problems cast in nonverbal form would in- 
volve implicit verbalization on the part of the subject. On theoretical 
grounds, it would seem that the essentially verbal character of “ideas” 
would not permit their appearance in any other than verbal tests. The 
present study has not attempted to make a direct solution of the ques- 
tion of the verbal or nonverbal character of the V factor; it was 
thought, however, that in view of the extent and diversity of the test 
material, the results might suggest a proper mode of attack on this 
problem in future work. 

Throughout the previous studies of the primary mental abilities, 
the interpretation of the factor W has remained somewhat doubtful. 
In the 57-test battery of Thurstone (11), the highest W saturations 
were found for tests in which the subject deals with single and iso- 
lated words, usually without regard to the meanings of these words. 
In later studies, the single-word feature of the W tests was again no- 
ticed, but there was a suspicion that this was merely a coincidence. 
The tests seemed to fall into two general types: (1) tests which in- 
volve words in which the letters are disarranged, and (2) tests which 
require the subject to think of appropriate words in a given situation 
—for example, any words having to do with food, or any words hav- 
ing the suffix -able. Wherever a factor seems to embrace two fairly 
distinct types of psychological functions there.is the possibility that 
the test batteries have lacked pure tests of these respective functions 
and that consequently the dimensionality of the factor system has 
been too low. In such a case a new factor study should seek to split 
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up the doubtful factor by attempting to find pure tests of each func- 
tion. The present study included as many types of W tests as pos- 
sible, but as in the case of the V factor it did not attempt to test any 
simple hypotheses regarding this factor, for the reason that such hy- 
potheses did not seem available. The only hypothesis which was con- 
sidered in assembling the battery was to the effect that the W factor 
is an associational facility with familiar and common words. 

The general plan of the study has embraced a large number of 
subsidiary problems. Many of the detailed questions asked in this in- 
vestigation will be more conveniently mentioned in connection with 
the test battery, but it will be useful to discuss here several of the 
more general problems. 

One of these problems was to determine the place, in the domain 
of verbal abilities, of the oral speech abilities involved in everyday 
communication. It was sought to discover whether what may be called 
“general speech fluency” or more popularly “gift of gab” is an opera- 
tional unity unrelated to intellectual abilities as represented by Thur- 
stone’s V and W factors. Thurstone has suggested (11, p. 85) that the 
W factor is associated with some sort of verbal fluency, though he has 
not included tests of speech ability in his experimental batteries of 
written group tests, since such tests are of necessity administered in- 
dividually. The present study has also attempted to discover in what 
way the quality and the quantity of speech behavior are differentiated 
and to what extent such variables as confidence in speaking and oral 
motor skill are important in this area of behavior. 

The problems of ability in written composition and general facil- 
ity in writing are somewhat similar to those of speaking ability. We 
may ask whether there is an operational unity, “facility and readiness 
in writing,” which is independent of previously discovered factors. A 
negative answer to this question is suggested by the fact that the qual- 
ity of written composition as rated by English teachers was found by 
Thurstone to have an appreciable loading (.357) on the V factor 
(11). A hypothesis which the present study was expected to test was 
that the number of words written in a theme is to some extent a func- 
tion of simple speed of handwriting. It was also thought that speak- 
ing and writing ability may have in common something which may 
be described as the ability to organize the elements of complex stimu- 
lus situations in coherent verbal form. 

Finally, it has been the hope of the writer that the identification 
and interpretation of the primary abilities involved in speech and lan- 
guage behavior will eventually lead to a better understanding of the 
mental processes and psychological laws underlying verbal behavior 
in human beings. ‘ 








282 PSYCHOMETRIKA 


It was necessary to include in the experimental battery a number 
of tests which would define certain factors which had been previously 
established by the studies of Thurstone and others and which were 
considered relevant to our problems. It. would have been desirable to 
have included tests of all the previously identified primary mental 
abilities, and if it had been feasible the writer might have used the 
machine-scored Tests for Primary Mental Abilities, issued by the 
American Council on Education. The latter tests, however, require a 
total testing time of some five hours. Since the writer’s testing time 
was limited, only three primary factors, V, W, and M, were selected 
for inclusion in the battery. 

The factor V (Verbal Relations) was represented by Thurstone’s 
tests Inventive Opposites (G-26) *, Verbal Analogies (G-20), and Gram- 
mar (G-19). New tests which were expected to involve the V factor 
were Morpheme Recognition (G-30, G-31), Vocabulary (G-36), Dis- 
torted English (G-37), and Nonsense Numbers (I-56). These are de- 
scribed below. Thurstone’s W (Word Fluency) factor was represent- 
ed by Disarranged Words (G-25) and Anagrams (G-23), both copied, 
with minor modifications, from Thurstone’s 57-test battery (11). In 
addition, Disarranged Words II (G-13), Suffixes (G-22), Rhyming 
(G-24), and Disarranged Morphemes (G-40), all constructed by the 
writer, were included to test certain hypotheses concerning the W 
factor. The M (Memory or Rote Learning) factor was represented 
by Thurstone’s Word-Number test (G-39) and by a Paired Associates 
test (G-34, G-35) constructed by the writer. 

The tests finally assembled in the present battery, whether taken 
from previous sources or constructed by the writer, are listed and de- 
scribed below. 

Disarranged Words II (G-13) was prepared by the writer as a 
test of the W factor. It is similar to Thurstone’s Disarranged Words 
test (included in the present battery as G-25) except that no clue is 
given as to the meanings of the words whose letters are disarranged. 

Free Writing (G-14, G-15, G-16) is similar to Thurstone’s Theme 
Writing test (11, test no. 52), but whereas Thurstone asked his sub- 
jects to describe a friend or acquaintance, the writer set the task of 
writing a theme on the international situation. Three scores are de- 
rived from the themes, identified as follows: G-14 is a composite rat- 
ing, made by a number of competent judges, of the excellence of the 
theme apart from the amount of information exhibited by the subject 


* Each test (or score on a test) is identified by a code number throughout the 
present paper. The letter G is prefixed to the code numbers of group tests, the 
letter I to those of individual tests. 
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and the merits of his opinions. G-15 is the raw number of running 
words written in the theme. G-16 is the number of different words in 
the first 200 running words of the theme; this is a measure of the 
amount of repetitiveness, or (the scaling being in the opposite direc- 
tion) of the diversity of vocabulary (2). 

Grammar (G-19) is identical with the test used by Thurstone 
(11, test no. 57) except for a change in time limit. 

Verbal Analogies (G-20) is virtually identical with Thurstone’s 
test (11, test no. 41). 

Spelling (G-21) is a list dictation test of spelling ability. 

Suffixes (G-22), prepared by the writer, is modeled after a Suf- 
fixes test devised by Thurstone (15) which required the subjects to 
give all the words ending in the suffix -able which they could recall in 
the time allowed. The writer decided to use the suffix -en for the pres- 
sent test with the intention of making it sufficiently difficult for a 
college population. 

Anagrams (G-23) is similar to the Anagrams test employed by 
Thurstone (11, test no. 15) except that the word OCCUPATION was 
substituted for PERVERSENESS, the test word used by Thurstone. 

Rhyming (G-24). A test of rhyming ability employed by Thur- 
stone (15) required the subjects to give four rhymes each to a list of 
some twenty words. For a college population, such a test seemed too 
easy. The writer therefore required the subjects to give as many 
rhymes as possible in a minute to each of a set of four words, graded 
in difficulty on the basis of the number of rhymes which several pre- 
liminary subjects were able to give. 

Disarranged Words I (G-25) is identical with the Disarranged 
Words test used by Thurstone (11, test no. 12) except that it is short- 
er than the original test, only 7 of the 12 words in each meaning cate- 
gory being used. The time limit was set at 4 minutes. 

Inventive Opposites (G-26) is virtually identical with Thurstone’s 
test (11, test no. 10). 

Phrase Completion (G-27) was devised by the writer in order to 
measure the extent to which individuals tend to conform to the lin- 
guistic norm. The subjects are asked to complete items such as the fol- 
lowing with the first word that comes to mind: “Hounds and __...... ” 
“And what do you ................ po I ND icc ks ” In a prelimi- 
nary study, a test composed of approximately 75 items was adminis- 
tered to several classes in psychology at the University of Minnesota. 
Frequency distributions were made of the responses to each item, and 
on the basis of these a scoring system was devised to measure the 
“community of response.” Thus, in general, a credit of 3 was given to 
the most frequent response; 2 to the next most frequent; 1 to the 
third most frequent; and 0 to a response which did not appear com- 
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monly in the responses of the population studied. An item analysis 
which was then carried out yielded 24 items which had sufficient dis- 
crimination power, on the basis of the total test score, to justify their 
inclusion in the present test. The test does not have a time limit. 

The Speech Attitude Scale (G-28) is a published self-rating scale 
devised by Knower (6) to measure confidence and poise in speech sit- 
uations. It was included in the present battery in order to see whether 
any of the primary mental abilities are associated with confidence in 
speaking. 

Handwriting (G-29), devised by the writer, is presumably a 
measure of normal speed of handwriting. The subjects are required 
to copy a paragraph in blanks which are provided between the lines 
of the text. The score is a function of the number of letters written 
in 110 seconds. The test was included in order to provide a statistical 
control of speed of handwriting in the case of tests like G-15, G-32, 
and G-37 where speed of handwriting may be involved. 

Morpheme Recognition (G-30, G-31) has been completely de- 
scribed in a previous publication of the writer (3). It was originally 
devised as a test of the ability to recognize the meanings of roots, suf- 
fixes, and prefixes of Latin or Greek origin in the English language. 
Two scores are derived from the test: G-30 is derived from the re- 
sponses in the left-hand parts of the items (Examples), and G-31 is 
the number of correct responses in the right-hand parts of the items 
(Meanings). In the present battery, this test was a time-limit test. 

The Letter-Star Test (G-32, G-33) had been devised by the writ- 
er several years before the planning of this investigation in connec- 
tion with the problem of the mathematical theory of word-frequency 
distribution (2). In this test, the subject is presented with patterns 
of letters and asterisks such as * Y * §. He is to respond by substitut- 
ing a word of his own choice for each symbol in the pattern, with the 
sole restriction that words substituted for capital letters must begin 
with the letter indicated. A sample response for * Y * § might be Is 
your father sick? In the construction of the test, the frequencies with 
which the various letters appear were determined according to the 
frequency distribution of initial letters in English; some adjustment 
was made, however, for the initial letters of the most common words; 
e.g., for T in the, O in of. The two scores which were derived from 
the subjects’ responses in the present investigation are: G-32, the 
number of items completed in 10 minutes, and G-33, the number of 
different words in the first 100 running words of the responses. 

Paired Associates (G-34, G-35) was devised by the writer as a 
test of the M factor, with special reference to the way in which the 
memory factor might be expected to be important in learning foreign 
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languages. In the practice period, the subject is required to memo- 
rize a vocabulary of Turkish words with their English meanings. On 
the two test pages, he is asked first to give the English meanings of 
the Turkish words and then to give the Turkish equivalents of the 
English words. Separate scores (G-34, G-35) are derived from each 
of the test pages. The writer’s test differs from Thurstone’s memory 
tests with respect to the way in which the subject is given opportun- 
ity to learn the material to be memorized. Thurstone, in most cases, 
has merely required the subjects to reproduce the associations once 
during learning and then to study silently until time is called. The 
writer, reversing this procedure, required two minutes of intensive 
study of the associations before preliminary written practice of the 
associations was attempted. It was believed that in this way closer 
attention would be paid to the material and that the preliminary prac- 
tice would aid learning to a greater extent. This procedure was also 
devised in order to minimize individual differences in ability to organ- 
ize the learning. 

Vocabulary (G-36), devised by the writer, is similar to current 
multiple-choice vocabulary tests. It was believed that the present test 
would prove to have a more desirable score distribution, range of dif- 
ficulty, and sensitivity than either of the tests employed by Thurstone 
(11, tests no. 58 and no. 60). 

Distorted English (G-37) was constructed in an attempt to meas- 
ure the ability to perceive meaning in foreign language idiom. It is 
the experience of foreign language teachers that students often have 
difficulty in assembling a number of isolated and apparently disar- 
ranged meaning-elements into a larger meaningful whole. One way in 
which such an ability might be measured would be to ask the subject 
to make an idiomatic rendering of sentences in French or German 
translated word-for-word into English. In order to control the fac- 
tor of previous foreign-language experience, the writer used literal 
translations of passages in more exotic languages—namely, Hungar- 
ian and various American Indian languages. In the scoring, which 
was made as objective as possible, credits are given for the correct 
rendition of certain features in the literal translation. The test was 
administered as a time-limit test, but it later appeared that this was 
unfortunate, since there were large differences in readiness to guess, 
exhibited, for example, by excessive slowness on the part of some 
subjects who were at the same time more accurate in their responses 
than speedier subjects. 

Word-Choice (G-38), assembled by the writer, is in form some- 
what similar to Grammar (G-19). Most of the items concern pairs of 
words which are commonly confused, such as derisive and derisory. 
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Memory I (G-39) is identical with Thurstone’s Word-Number 
memory test (11, test no. 46), except that the second fore-exercise has 
been omitted. 

Disarranged Morphemes (G-40), devised by the writer, was in- 
cluded in order to test the hypothesis that the W factor involves the 
ability to arrange various linguistic units in meaningful order. In 
contrast with tests which involve the rearrangement of letters into 
words, this test involves the rearrangement of syllables (morphemes) 
into two-word phrases. A sample item is: 

-s quire ex ing re act ment _........................... , 
The subject is asked to rearrange these elements into two long words, 
an adjective and a noun (exacting requirements). 

Similes (G-41) is identical with that used by Stumberg (8) in 
a study of poetic ability. The subjects are asked to give as many sug- 
gestions as possible for completing lines of poetry which require the 
use of simile. The score is simply the number of responses given, re- 
gardless of quality. The subjects were allowed 2 minutes for each of 
the 4 items of the test. 

Normal speed of oral reading (1-42). The subject is required to 
read aloud a prose paragraph. The score is a function of the dura- 
tion of reading in seconds. 

Fastest speed of oral reading (I-43) is similar to I-42 except that 
the subject is asked to read aloud another paragraph as fast as pos- 
sible without being unintelligible or inaccurate. 

Naming states of the Union (1-44) is a test in which the subject 
is asked to name the states of the United States as fast as possible 
within the time-limit. 

Giving first names (I-45) is similar to the preceding test except 
that the subject is asked to give, orally, all the first names, either 
boys’ or girls’, that he can think of. 

Memory for homophones (1-46) is similar to a test used by Davis 
in studying differences in imagery type (5). The subject is allowed 
to view a word-square composed of sets of homophones (such as 
CENT, SCENT, SENT) for 10 seconds, after which he is asked to 
reproduce the word-square as accurately as possible from memory. 
The scoring technique is similar to that recommended by Davis. 

Speed of articulation (I-47) is a measure of the speed with 
which the subject can pronounce certain consonants in a series such 
as papapupa. .. (where a represents a neutral vowel). The score is a 
function of the number of seconds taken to make forty articulations. 

Auditory memory span (1-48) is similar to a test devised by An- 
derson (1), who reports that it is correlated with intelligence, achieve- 
ment in foreign languages, and English usage. It is administered and 
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scored like conventional digit-span tests, but the elements to be mem- 
orized are simple vowel sounds rather than digits. 

Picture Description (1-49, I-50, I-51, I-52) requires the subject 
to respond to a picture orally and in his own words. The picture to 
which the subjects are asked to respond is the portrait of Cardinal 
Guevara, “The Cardinal Inquisitor,” painted by the artist known as 
El Greco. The subject, after being told how to use the Dictaphone, is 
read a paragraph of standard instructions and allowed to view the 
picture. He is then given two minutes to consider what he is to say, 
after which he is required to speak into the Dictaphone as continu- 
ously as possible for two minutes, still viewing the picture. The fol- 
lowing scores are obtained from typewritten transcriptions of the 
Dictaphone recordings: I-49 is the number of “relevant” words spok- 
en during the two minutes. The “relevant” words are considered to 
be the words which the subject “meant” to say and which would re- 
main if the speech response as a whole were to be edited and freed 
of hesitations, repetitions, rephrasings, “ah’s” and “er’s,” and the 
like. I-50 is the ratio of the relevant words to the total number of 
words (both relevant and irrelevant). This is claimed to be essen- 
tially a measure of the coherence or continuity of the speech response 
and has been used previously by Stinchfield (7). I-51 is a composite 
rating, by expert judges, of the quality of the speech response as 
transcribed ; in many respects it is similar to the rating of the themes 
(G-14). I-52 is a measure of diversity of vocabulary, the number of 
different words in the first 100 relevant words of the speech response. 

Form-Naming (1-53) and Color-Naming (I-54) are tests which 
were originally devised by Woodworth and Wells (17). They were 
included here because they seemed to involve a type of facility in ver- 
bal association. The scores are functions of the time taken in naming 
the forms or colors. 

Paragraph Memory (1-55) is taken from the Stanford-Binet in- 
telligence scale (9, pp. 186, 188), and is scored by the method of re- 
tained members. After hearing a paragraph read by the administra- 
tor, the subject is asked to reproduce it orally from memory as accu- 
rately as possible. 

Nonsense Numbers (1-56) was devised by the writer as a test of 
one aspect of the ability to learn and comprehend foreign languages 
as spoken. The subject is taught a simple artificial system of number 
expression utilizing nonsense syllables. This is analogous to teaching 
the number system of a foreign language. The subject is then asked 
to write down the arabic numeral equivalents of a list of numbers in 
the artificial system read aloud in a standard fashion by the experi- 
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menter. The score is the number of digits correctly written on the 
answer blank. 

The 42 tests were arranged in two group testing sessions of two 
hours each and one individual testing session of one hour.* The 
Speech Attitude Scale (G-28) was filled out by the subjects outside 
of the test periods at leisure. 

The subjects were for the most part college undergraduates at 
the University of Minnesota who volunteered to take the tests on he- 
ing promised individual reports of their standings. Although more 
than 170 individuals took at least some of the tests, only 119 cases 
were found to be complete. Of these 119 subjects, 57 were men and 62 
were women. With respect to educational status, the subjects were 
distributed as follows: Freshmen, 28; Sophomores, 37; Juniors, 21; 
Seniors, 20; Graduate students, 9; Adults not in school, 2; Unknown, 
2. A large number of the subjects were majoring or were planning to 
major in academic fields involving language, such as English composi- 
tion, speech, foreign languages, and journalism. All subjects were 
native speakers of English, but there was found to be considerable 
variety in home language background. Data on the academic achieve- 
ment and general scholastic aptitude of a considerable number of sub- 
jects were available at the University Testing Bureau. If we assume 
that these subjects are representative of the total group of 119 sub- 
jects, it can be concluded that the group was highly selected, since the 
means of our samples with respect to high school percentiles and col- 
lege aptitude tests were significantly above the corresponding means 
for the liberal arts college population. 

Before the scores on the 42 variables were used in computing the 
correlational matrix necessary in the factorial analysis, it was con- 
sidered desirable to take two steps; namely, (1) normalization (where 
necessary) of the raw score distributions, and (2) coding of the score 
distributions in ten class intervals so that the data for a single case 
could be punched on a standard Hollerith card of 80 columns, each 
variable being represented by one column. With the exception of sev- 
eral studies in which a two-factor type of analysis was used, this is 
probably the first factorial study in which score distributions have 
been normalized. Thurstone, in his first large factorial study (11), 
used tetrachoric rather than product-moment correlation coefficients 
on the ground that the use of tetrachoric correlations automatically 
normalizes the underlying score distributions, thus satisfying one 


* A micro-film copy of the test battery, including instructions and fore-exer- 
cises, is available for 80¢ as an Auxiliary Publication, Document 1597, of 
the American Documentation Institute, Offices of Science Service, 2101 Constitu- 
tion Ave., Washington, D. C. 
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of the assumptions of multiple-factor analysis. He admitted, how- 
ever, that “the most complete procedure would . . . seem to be 
to normalize each of the distributions of raw scores and then to 
compute the product-moment coefficients” (11, p. 58). In subse- 
quent factorial studies of Thurstone, tetrachoric correlations were 
discarded in favor of product-moment correlations, since the former 
appeared to introduce an unreasonabie amount of error variance, 
but in no case has the original suggestion of normalizing the dis- 
tributions been carried out. In the present study it was decided to 
make reasonably sure that all score distributions involved in inter- 
correlations were normal. Quite apart from any considerations of the 
effect of distribution form on factorial structure, the assumptions un- 
derlying the product-moment correlation coefficient justify this step. 
The ultimate justification for the normalization of score distributions 
is the assumption that mental abilities are in reality distributed nor- 
mally and that the deviation of a distribution from normality is a 
function of the specific character of a test, the conditions under which 
it is administered, the scoring technique, or the sampling of subjects. 
Many of the raw score distributions were surmised to be normal, at 
least with respect to skewness, merely by inspection; no rigorous test 
was applied to these distributions because of the labor which would 
have been involved. All distributions which appeared suspiciously 
nonnormal were tested for normality by R. A. Fisher’s g statistics; as 
it happened, all these distributions were found to be skewed and in 
many cases nonmesokurtic. The distributions which were found to 
deviate from normality were transformed by various functions until 
the statistical test left little doubt that they were normal. 

The product-moment intercorrelations, presented in Table 1, 
were computed from sums of squares and cross-products obtained by 
Hollerith-machine procedures. The values were not corrected for 
grouping or for attenuation. The coefficients are for the most part 
positive in sign, the largest negative coefficient in the table being 
~.251. Variables G-16, I-48, and I-52 were eliminated from the cor- 
relational matrix used in the factor analysis because they were seen 
to have little correlation with other variables. The correlations of 
tests G-30 and G-31 with other tests are not used in the final correla- 
tional matrix. These tests had such a high correlation with each other 
(vy = .888, or 1.013 when corrected for attenuation) that it was 
deemed advisable to combine them into a new variable, G-30a. All 
correlations with G-30a are computed on the basis of the sums of the 
paired coded scores on variables G-30 and G-31. A similar procedure 
might have been employed in the case of tests G-34 and G-35, which 
were also highly correlated (vr = .835, or 1.016 when corrected for at- 
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tenuation), but for the sake of experiment it was decided to leave 
these scores separate in order to see how the factorial structure would 
be affected. 

After the changes described in the preceding section had been 
made, a correlational matrix of 38 variables remained to be analysed 
by the multiple-factor analysis of Thurstone (10). The first step in 
this procedure was to find the centroid matrix of factor loadings on 
arbitrary co-ordinate axes. This is presented in Table 2. Ten factors 
were extracted from the correlational matrix; no more factors were 
taken out since the tenth factor residuals seemed small enough, when 
all criteria which were then available were considered, to indicate 
that little common-factor variance remained in the residual table. As 
will be seen, only nine factors could subsequently be rotated to simple 
structure, the tenth factor being made a residual plane. On the basis 
of a criterion recently developed by Coombs for determining the 
presence of significant common factor variance in a residual table 
(4), it has been found by the writer that it would have been profitable 
to have extracted another factor or possibly several factors after the 
tenth centroid factor in order to obtain a more convincing structure 
than the one reported in this paper. Nevertheless, according to 
Coombs the presence of one residual plane in the rotated factorial 
structure insures that enough centroid factors have been extracted to 
justify the psychological interpretation of the primary factors ob- 
tained. 

Table 2 also presents the communalities (h?) of the test vari- 
ables, values which indicate the proportion of variance in the test 
scores which is accounted for by the ten common factors extracted. 

The second and final step in the factorial analysis was the rota- 
tion of the arbitrary orthogonal axes to the primary axes of a simple 
structure. The rotation of the present centroid matrix was accom- 
plished partly by the method of extended vectors (13). Use was also 
made of certain other procedures which have not as yet been fully 
described in the literature. It will suffice to say that a theory of cor- 
related primary factors developed by Tucker (16) underlies many of 
the methods employed by the writer. 

It was possible to rotate 9 dimensions into simple structure, the 
10th dimension remaining on a residual plane not subject to psycho- 
logical interpretation. The transformation matrix, which in the pres- 
ent case was obtained after 17 rotations, is shown in Table 3, and the 
final rotated factorial matrix, consisting of projections of the test 
vectors on primary planes, is presented in Table 4. The cosines of the 
angles between the reference vectors underlying the final projections 
are shown in Table 5. It should be inferred from this table that sim- 
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ple structure demanded other than strictly orthogonal reference vec- 
tors. As a result, the correlations of the primary factors in many 
cases deviated from zero to an appreciable extent; these correlations 
are shown in Table 6. The matrices of Table 6 have been factored to 
obtain the saturations of the primaries in a second-order general fac- 
tor according to a formula originally developed by Spearman and 
modified by Thurstone (10, p. 146). These saturations are given in 
Table 7. 

The practice of designating primary factors by letters or sym- 
bols which are intended to suggest the nature of the corresponding 
abilities (or the corresponding general traits, in the case of factor 
studies of personality) is objectionable, in the opinion of the writer. 
A certain factor, for example, which Thurstone found in a series of 
studies and interpreted as a verbal factor, has been called V, but the 
present study appears to have broken up this factor into several fac- 
tors. With the rapid strides in factorial research it is becoming ap- 
parent that the convenience of such a practice is illusory. Until the 
ultimate unities of ability have been isolated and interpreted in a de- 
finitive manner, it seems prudent to designate the factors in each 
study by purely arbitrary tags. This paragraph will serve to explain 
the writer’s practice. 

The location of the primary trait vectors designated as C and J 
presented the only serious problem in the process of rotation. The 
crux of the difficulty was whether C and J could best be regarded as 
correlated or as uncorrelated primary factors. It was found that 
when the reference vectors C and J were rotated into simple struc- 
ture, they were highly oblique, the cosine of their angular separation 
being —.40, a figure connoting a substantial positive correlation of 
the corresponding primaries. Nevertheless, there seemed to be a fair 
likelihood that a corner of the configuration was missing, and that the 
factors C and J were not to be regarded as correlated. Factor C was 
thought to be similar to the verbal factor V previously identified by 
Thurstone, and factor J was taken to be some sort of reasoning factor. 
Inasmuch as the tests having high projections on the J plane included 
verbal material which would be expected to result in appreciable load- 
ings on the C factor, the reference vectors were set orthogonal, with 
the result that the tests of the primary J were given appreciable pro- 
jections in the general dimension of C. This rotation resulted in a 
new set of projections for all the tests in this dimension; this new set 
of projections, for the uncorrelated case, is given in column C’ of 
Table 4. In any event, the problem of rotation discussed here is not 
crucial in the interpretation of the factors involved. 

Inspection of the rotated factorial matrix (Table 4) reveals that 
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in the main a positive manifold has been obtained, 7.e., that most of 
the appreciable projections are positive and that few of the negative 
projections deviate substantially from zero. This is the usual result 
in the factor analysis of mental abilities. Only two negative projec- 
tions appear to be significantly different from zero; namely, that of 
test G-28 on C or C’ and that of test G-33 on H. 

We may now consider the interpretations of the factors. Projec- 
tions of .30 or greater will for convenience be regarded as significant 
for the purposes of interpretation. 

One of the clearest factors identified in the present study is the 
C or C’ factor. The tests which have projections on C and C’ which 
can be regarded as significant are listed below, together with their 
significant loadings on other factors. 


Code 

No. Test C Cc’ Other projections 
G-38 Word-Choice 52 64 —— 

G-36 Vocabulary 43 55 G (.387) 

G-27 Phrase Completion AT 52 H(.33) 

G-19 Grammar 44 49 E (.38) 

I-46 Memory for homophones 43 48 ant 

G-24 Rhyming 46 47 — 

G-21 Spelling 40 44 D(.41) 

G-30a Morpheme Recognition (.21) 42 J (.41) 

G-40 Disarranged Morphemes (.23) 42 J (.38) 

G-14  Theme—Rating 389 41 G(.89) 

G-13 Disarranged Words II (.28) OT — 

I-55 Paragraph Memory (.25) 35 F'(.39) 

G-37 Distorted English 30 34 E'(.83); G(.48) 
G-22 Suffixes (.27) o2 A (.55) 

G-28 Speech Attitude Scale —.36 —Al — 


It is fairly obvious that the tests which have appreciable positive 
loadings on this factor involve some sort of intellectual verbal ability. 
It is to be noted that two tests which have high projections in the list 
above (G-36, G-19) are similar to corresponding tests in Thurstone’s 
study (11) which had high projections on what was designated as 
the V (Verbal Relations) factor. On the basis of the factorial com- 
position of these and similar tests in the list given above, the present 
C factor can with considerable confidence be closely identified with 
the previously discovered V factor. Nevertheless, it sometimes hap- 
pens that for various reasons a factor in one investigation is resolved 
or split into two or conceivably more than two factors in subsequent 
investigations. In this way, it may be conceived that a subsequent 
investigation may sample only one of several sub-factors underlying 
a single factor in a previous study. It is therefore quite possible that 
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the C tests in the present battery have sampled only one or several 
constituent factors in what Thurstone has quite justifiably regarded 
as a single factor, on the basis of his data. Whatever the case may be, 
it can at least be said that the present C factor has something in com- 
mon with the V factors found in previous factorial studies. It is to 
be carefully noted, however, that two tests of Thurstone’s V, Inven- 
tive Opposites (G-26) and Verbal Analogies (G-20), do not appear on 
the present C factor. The issues raised by this fact will be discussed 
subsequently. 

Merely to say that the present C factor involves some sort of in- 
tellectual verbal ability is unsatisfactory. Tests exist in the battery 
which can also be regarded as involving intellectual verbal ability but 
which do not have significant projections on C or C’. 

Close examination of the data available leads the writer to con- 
clude tentatively that this factor represents the individual differences 
in some aspect of the ability to learn various conventional linguistic 
responses and to retain them over long periods of time. The factor 
represents differences in the stock of linguistic responses possessed 
by the individual—the wealth of the individual’s past experience and 
training in the English language. By conventional linguistic response 
may be understood any fact of speech behavior which is essentially 
arbitrary but which occurs with a certain frequency in definite situa- 
tions. A response (eé.g., the response underlying a phoneme) may not 
even have any intrinsic semantic value, though most linguistic re- 
sponses do have such a value. The concept of conventional linguistic 
response described here is exemplified by words and meanings of 
words; phonological, morphological, and syntactical features of the 
language; certain expressive gestures; and patterns of idiomatic ex- 
pression. (The writer assumes that formal characteristics of a lan- 
guage correspond in some way to responses in a psychological sense.) 

Many tests of the C factor listed above can be regarded as tests 
of the presence or absence of certain conventional linguistic responses 
under certain stimulus conditions. Grammar (G-19) tests the pres- 
ence (either by recognition or recall) of certain morphological and 
syntactical responses. Several tests involve the size of vocabulary, 
such as Word-Choice (G-38), Vocabulary (G-36), Spelling (G-21) 
(since a number of infrequent words were included in the test), Mor- 
pheme Recognition (G-30a), Disarranged Morphemes (G-40), and 
possibly Rhyming (G-24) and Suffixes (G-22), if it is considered that 
individuals possessing large vocabularies are at an advantage in these 
latter tests. Phrase Completion (G-27) tests the presence of certain 
conventionalized patterns of expression, which, although utilizing 
rather common words for the most part, are themselves used with 
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varying frequency and which have many of the characteristics of 
conventional linguistic responses as described here. Test G-14 
(Theme—Rating) can easily be regarded as involving the richness 
of the subject’s stock of linguistic responses, particularly those char- 
acteristic of standard or accepted speech. 

The interpretation of the C factor made in the preceding para- 
graph does not apply so obviously to the remainder of the tests listed 
above. Memory for Homophones (I-46) has a fairly high saturation 
on C and no other appreciable projections. In the light of as yet un- 
published studies on memory abilities conducted by Thurstone, the 
writer believes that in the present battery the memory element in 
this test remains in its specific variance inasmuch as the particular 
type of memory ability involved is not tapped by any other test in 
the battery. If this is the case, the common factor variance of this 
test is not to be related to its memory element but to some other 
element, most probably to its verbal nature, since it utilizes pairs or 
triplets of homophones such as CENT—SENT—SCENT. The indi- 
vidual’s knowledge of homophones acquired in past linguistic experi- 
ence would probably be of service in performing this test, and such 
knowledge might possibly be drawn from the stock of linguistic re- 
sponses which, according to the hypothesis maintained here, is rep- 
resented by the C factor. Disarranged Words II (G-13) has an appreci- 
able saturation with C, but, contrary to expectation, no very remark- 
able projection on either of the factors which, as claimed below, are 
related to Thurstone’s factor W. Most of the common factor variance 
in the test appears to be covered by the C factor. This result becomes 
more plausible if it is recalled that the test was constructed with 
words of decreasing frequency of occurrence. The appearance of 
Paragraph Memory (I-55) among the C tests may be interpreted as 
due to the relatively difficult vocabulary in the test paragraphs. The 
small but appreciable saturation of Distorted English (G-37) may be 
accounted for by the possibility that this test involves a knowledge of 
grammatical patterns. 

We may now ask why Inventive Opposites (G-26) and Verbal 
Analogies (G-20), tests which Thurstone found to have appreciable 
projections on his V factor, do not appear among the C tests in the 
present factorial structure. It may be noted that neither of these tests, 
at least for the college population of subjects used here, can easily be 
regarded as involving individual differences in extent of vocabulary 
or wealth of linguistic responses. The words used in Verbal Analogies 
are common, and the factor making for variation in performance ap- 
pears to be some sort of reasoning ability rather than knowledge of 
linguistic responses. Nor does extent of vocabulary appear to be high- 
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ly important in Inventive Opposites, where the score is merely the 
number of words written, without regard to their adequacy in refer- 
ence to the task set. The subject is likely to give any response which 
he thinks may be acceptable. If only correct responses were scored, 
or if the test were constructed in multiple-choice form with initial 
letters of possible answers given (as has been done in the machine- 
scored form of the test issued by the American Council on Education), 
there would be a substantial probability that the test would measure 
the ability represcuted by the C factor of the present study. This 
would also be the case if the test were administered to school children 
not familiar with some of the words used in the test. 

The writer is inclined to believe that Thurstone’s V factor is rep- 
resented in the present investigation by two or possibly three compo- 
nent factors, C, J, and possibly G. This belief is supported by the fact 
that several tests which in the light of Thurstone’s findings were ex- 
pected to be pure C tests actually appear in other factors. This was 
true of Verbal Analogies (G-20), which appears in J, and of Inven- 
tive Opposites (G-26) and Theme—Rating (G-14), which appear 
in G. Furthermore, this belief seems to be compatible with the inter- 
pretations of these factors which are offered. It would be fairly easy 
to design an experiment to yield further information on this point. It 
seems fairly clear, at least to the writer, that the present C factor does 
not directly involve the manipulation of ideas or relationships but 
merely represents the knowledge of verbal tokens which underlies the 
manipulation of ideas and relationships. If anything, Thurstone’s de- 
scription of the factor V seems to apply to the factor J of the present 
study rather than to the factor C. Moreover, on the basis of the sat- 
urations of factors C and J on a second-order general factor (Table 
7), factor J appears to behave like Thurstone’s factor V (which ac- 
cording to a recent study [14] seems to have a high saturation on a 
general factor) more than does factor C. 

The substantial negative projection of the Speech Attitude Scale 
(G-28) on C is of interest. A tentative hvpothesis useful in account- 
ing for this result is that many individuals who have large stocks of 
linguistic responses are, so to speak, embarrassed by trop de richesse 
and have difficulty in selecting the most effective responses in a given 
situation. Persons of average verbal ability, on the other hand, rarely 
stop to choose words carefully. It is important to note, however, that 
the C factor is negatively related only to confidence in speaking ability 
and not to actual speaking ability as presumably measured by tests 
I-49, I-50, and I-51. 

The three tests which have substantial projections on the factor 
J are Verbal Analogies (.54), Morpheme Recognition (.41), and Dis- - 
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arranged Morphemes (.38). The common element in these tests seems 
to be some sort of reasoning ability or ability to handle verbal rela- 
tionships. Verbal Analogies (G-20) seems to be a pure test of J, hav- 
ing no appreciable projection on C, although previous results would 
lead one to expect it to have a substantial projection on C. As has 
been suggested above, factor J appears to conform to the interpreta- 
tion of the factor V offered by Thurstone—namely, that the factor V 
involves the manipulation of ideas. The writer is of the opinion that 
some of Thurstone’s V tests such as Disarranged Sentences, Verbal 
Classification, and Word-Grouping (11) would have appeared on fac- 
tor J if they had been included in the present battery. 

The factor G seems to be one of the most difficult to interpret on 
the basis of the present data. The author has not been able to arrive 
at any interpretation of the factor which can satisfactorily account 
for all the tests with appreciable projections on it. These tests are: 
Picture Description—Rating (.53), Distorted English (.48), Similes 
(.44), Theme—Rating (.39), Maximum Speed of Oral Reading (.37), 
Inventive Opposites (.37), Speed of Handwriting (.37), Vocabulary 
(.37), Normal Speed of Oral Reading (.32), Picture Description— 
No. of relevant words (.32), and Letter-Star—No. of responses (.30). 
It has been suggested above that this factor (in its present state) isa 
component of Thurstone’s original V factor; it is further possible that 
this factor represents at bottom two or more separate factors which 
future investigation may reveal and that pure tests of these factors 
are missing in the present study. The only pure test of G is apparent- 
ly Speed of Handwriting (G-29), but it is difficult to conceive a con- 
nection between this test and Picture Description (I-51). It can readi- 
ly be seen, however, that many of the tests involve handwriting speed 
—for example, Distorted English, Similes, Theme—Rating and Inven- 
tive Opposites. Therefore, one component of the factor G may be 
handwriting speed. Until further investigation is made of the tests 
which appear on G in the present configuration, the writer will not 
attempt to interpret this factor. 

The tests with significant projections on A are as follows: Suf- 
fixes (.55), Form-Naming (.41), Disarranged Words I (.38), Word- 
Number Memory (.38), Color-Naming (.33), and possibly Giving 
First Names (.28). During the rotation of the axes this factor ap- 
peared to be connected with Thurstone’s W factor on account of the 
presence of Suffixes (G-22) and Disarranged Words (G-25) among its 
tests. Further consideration of the data leads the writer to conclude, 
however, that this is not identical with Thurstone’s W factor but that 
it is probably one component of it. The present investigation appears 
to have divided the original W factor into two constituent unities, fac- 
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tors A and E. Looking for an underlying unity in the tests listed 
above, we arrive at the hypothesis that this A factor involves the 
speed of word association (usually for common words) where there 
is some element of restriction in the task imposed; i.e., where only 
one or a certain number of responses from the total reserve are cor- 
rect. In Suffixes (G-22) and in Disarranged Words (G-25), for ex- 
ample, the test materials undoubtedly give rise to a number of implicit 
responses from which the subject must select the correct or acceptable 
responses. In the performance of Form-Naming (I-53) and Color- 
Naming (I-54), a similar process appears to be necessary to some ex- 
tent, for in each of these tests five responses have very high and prob- 
ably equal strengths, but the subject must select the appropriate re- 
sponse for each successive stimulus. In Giving First Names (I-44) it 
can be conceived that the subject must select appropriate responses 
from the reserve consisting of personal names, names identical with 
those previously given by the subject, and other names. The only test 
whose projection on A cannot be readily explained is Word-Number 
Memory (G-39), which correlates fairly highly with other A tests in 
the battery (see the correlational matrix, Table 1.) 

The tests which have appreciable loadings on the factor E are 
Theme—No. of words (.45), Grammar (.38), Similes (.36), Picture 
Description—Per cent of relevant words (.35), Distorted English 
(.33), and Anagrams (.31). Because of the presence of several tests 
which were formerly thought to be W tests, namely, Grammar (G-19) 
and Anagrams (G-23), it is believed that this is one component of the 
W complex discovered in previous investigations by Thurstone and 
others. Most of the E tests involve in some way the rate of production 
for meaningful and syntactically coherent discourse where there is 
little restriction to definite responses. The highest projection is that 
of Theme—Word Count (G-15), which clearly involves facility in pro- 
ducing sentences which are sufficiently meaningful to be accepted by 
the subject. A superficially comparable measure, Picture Description 
—No. of relevant words (I-49), does not appear in the above list be- 
cause, it is believed, it is not directly a measure of coherence, but only 
a measure of the amount which the subject had to say. Picture De- 
scription—Per cent of relevant words (I-50) appears among the EF 
tests because it is a fairly direct measure of coherence. Grammar 
(G-19) possibly involves an element of syntactical coherence, and the 
appearance of Similes (G-41) among these tests appears to be con- 
sistent with our hypothesis, although it seems to emphasize semantic 
rather than syntactical coherence. Distorted English (G-37) can be 
conceived as involving facility in bringing about syntactical and 
semantic coherence; in one sense Distorted English is a test of the 
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ability to organize implicit verbal behavior (generally thought to be 
somewhat formless or chaotic) into explicit verbal behavior which is 
acceptable as formal speech. We cannot explain the appearance of 
Anagrams (G-23) among these tests, but its projection is probably 
too small to cause much dismay. 

The tests with appreciable saturations in the factor H are Color- 
Naming (.49), Letter-Star Test—No. of responses (.42), Giving First 
Names (.41), Form-Naming (.41), Phrase Completion (.33), Naming 
States of the Union (.29), and Letter-Star Test—Diversity (—.42). 
The common characteristic of these tests is what may be described as 
readiness in attaching an appropriate name or tag to a stimulus (even 
if it is only an arbitrary name, as in the case of the Letter-Star test). 
In the case of tests I-44 and I-45 (Naming States of the Union and 
Giving First Names, respectively), the stimulus is implicit and may 
reside in the subject’s imagery. The negative loading of test G-33 on 
H is a result of the fact that tests G-32 and G-33 are negatively corre- 
lated (v= —.251), it being inferred that the subjects who are speedier 
in producing responses have more tendency to repeat responses and 
thus to use fewer different words. It should not be concluded that 
there is direct inhibition between H and test G-33, however. 

The four tests which have substantial projections on the factor F 
are Picture Description—No. of relevant words (.61), Picture De- 
scription—Per cent of relevant words (.58), Picture Description— 
Rating (.55), and Paragraph Memory (.39). This factor may in the 
first instance be regarded as speaking ability, or ability to give spon- 
taneous oral expression to one’s ideas in an effective and coherent 
manner, Alternatively, the factor may be interpreted as involving the 
subject’s ease and confidence in the specific experimental situation, a 
situation complicated by the presence of slightly discomforting appa- 
ratus (i.e., the Dictaphone). All the tests in the list above permit 
either interpretation, including Paragraph Memory (I-55), which in- 
volves an oral response somewhat similar to the responses required in 
the Picture Description test. Nevertheless, the fact that the Speech 
Attitude Scale (G-28) did not appear here seems to contradict, to 
some extent, the second of the alternative hypotheses, inasmuch as 
this test is presumed to measure almost precisely the kind of ease and 
confidence which is thought to be demanded in this experimental situ- 
ation. 

The factor B is represented by three tests, Paired Associates— 
Turkish-English (.79), Paired Associates—English-Turkish (.77), 
and Word-Number Memory (.41). This factor is easily seen to be 
similar to the rote learning factor M isolated in previous factoral in- 
vestigations. 
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Column D of the rotated factorial matrix has appreciable satura- 
tions in seven tests, as follows: Maximum Speed of Oral Reading 
(.67), Normal Speed of Oral Reading (.62), Speed of Articulation 
(.57), Spelling (.41), Letter-Star Test—Diversity (.37), Color-Nam- 
ing (.36), and Form-Naming (.29). The interpretation that this fac- 
tor represents motor skill in speech is obvious, and is based primarily 
on consideration of the characteristics of the first three of these tests, 
but the remaining tests seem to have elements on the basis of which 
they may be reasonably subsumed under the factor D. In the case of 
Spelling (G-21), there is a suggestion that spelling ability is associat- 
ed with motor skill in pronouncing words. A fairly plausible interpre- 
tation of the appearance here of the Letter-Star Test—Diversity 
(G-33) is that since the test involves the initial letters of words, gen- 
eral facility in articulation and in word pronunciation provides the 
subject with a greater range of responses which can be utilized in this 
situation. It is obvious, finally, that Color-Naming (I-54) and Form- 
Naming (I-53) involve speed of articulation. 

The finding of a generalized speed of articulation factor should 
be of interest to workers in the field of motor abilities, in view of the 
highly specific character of most types of motor ability. It is fairly 
safe to conclude that the present articulation factor is generalized 
over at least several fairly distinct speech movements. The writer has 
computed correlations between the speed measurements of the three 
speech movements in pronouncing the stops p, t, and k, utilized in the 
Speed of Articulation test. These correlations are: p and ¢t, r = .915; 
p and k, r= .900, t and k, r = .912. 

The factor designated K is represented by a residual plane and 
is not subject to psychological interpretation. 

The author is indebted to Professor L. L. Thurstone for generous- 
ly allowing him to use the facilities at the University of Chicago for 
completing the factorial analysis. Special acknowledgment is due Mr. 
Ledyard R. Tucker for assistance in making the rotations from the 
centroid matrix. 
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TABLE 1 


The Inter-test Correlations* 
(119 cases) 


13 14 15 19 20 21 22 28 24 2 26 








13 .297 .220 .858 .827 .822 .858 .485 .292 .419 .427 
14 297 817 .286 .168 .862 .289 .194 .416 .109 .329 
15 220 .317 195 .190 .201 .099 .260 .168 .230 .142 
19 358 .286 .195 3386 .607 .261 .312 .453 .431 .453 
20 327 .168 .190 .336 .281 .238 .820 .256 .393 .417 
21 322 .862 .201 .607 .281 838 .892 .470 .428 .871 
22 858 .289 .099 .261 .238 .338 317 .368 .368 .362 
23 435 .194 .260 .312 .320 .392 .317 322 .488 .343 
24 .292 .416 .168 .453 .256 .470 .3868 .322 261 .434 
25 419 .109 .230 .481 .393 .428 .868 .488 .261 332 


26 427 .829 .142 .453 .417 .3871 .862 .38438 .434 .332 

27 129 .200 .186 .280 .174 .270 .180 .174 .258 .216 .250 
28 -.131 .042 .054 -—161 -.005 -.047 .098 -.041 .041 -.034 .066 
29 212 .210 .303 .218 .109 .202 .182 .273 .229 .251 .206 
30a .3879 .247 .238 .529 .545 .498 .271 .3852 .3880 .375 .370 
32 199 .201 .892 .246 .167 .273 .274 .860 .153 .396 .284 
33 036 .203 -.058 .112 .141 .274 .076 -.016 .180 .058 .127 
34 356 .108 -.026 .268 .264 .165 .087 .230 .153 .252 .278 
35 398 .080 -.097 .278 .292 .2438 .120 .286 .190 .260 .317 
36 363 .527 .241 .504 .419 .599 .290 .3879 .456 .244 .518 
37 287 .831 .426 .358 .194 .805 .264 .350 .3875 .215 .426 
8 410 .380 .032 .425 .310 .414 .317 .283 .291 .234 .417 
39 189 .005 -.108 .163 .156 .072 .871 .250 .1138 .245 .3827 
40 478 .807 .3810 .493 .480 .488 .459 .454 .448 .441 .517 
41 071 .178 .428 .048 .0383 .105 .144 .172 .162 .125 .191 
42 123 .809 .286 .187 .229 .278 .200 .108 .265 .202 .194 
43 044 .454 .254 .186 .155 .340 .092 .098 .267 .093 .158 
ta 087 .043 .111 -.016 .202 .130 .824 .059 .125 .275 .080 
45 039 .071 .227 .112 -.061 -.047 .107 .096 .094 .145 -.035 
46 303 .103 .037 .248 .108 .260 .260 .1538 .418 .208 .161 
47 -.072 .095 .183 .012 .115 .144 -.082 -.063 .040 .054 —.125 
49 009 .264 .3878 .034 .032 .006 -.041 .006 .091 -—.031 .154 
50 058 .195 .219 .135 -.022 .140 -.090 .018 .140 -.026 .056 
51 045 .427 .196 .050 .016 —.105 .051 -.022 .227 -.062 .2387 
53 -205 .186 .196 .086 .255 .098 .293 .183 .152 .814 .210 
54 172 .154 .264 .082 .150 .284 .256 .248 .142 .409 .188 
55 283 .408 .180 .311 .300 .264 .219 .174 .255 .178 .252 
56 398 .090 .126 .317 .340 .234 .359 .870 .800 .896 .292 


16 015 -.003 .068 -.029 .051 -.055 .167 -.075 -.053 .055 .010 
30 384 .268 .245 .526 .503 .501 .264 .871 .879 .882 .320 
81 341 .211 .216 .501 .559 .464 .262 .810 .858 .344 .402 
48 173 -.050 .007 .091 .124 .053 .170 .148 .198 .067 .205 
52 -.045 .114 .006 .104 .093 .088 .109 -—.127 -.011 .053 .066 











* For convenience, the prefixes of the test code numbers have been omitted. The variables seg- 
regated at the end of the table were not used in the factor analysis. 
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TABLE 1 (continued) 


The Inter-test Correlations 








27 «28)«O29°«80asi32s—i«Bs(‘ KSC‘ “_S*é«éG:C“C«é«T:C*« 


13 129 -131 .212 .879 .199 .036 .356 .398 .363 .287 .410 
14 200 .042 .210 .247 .201 .203 .108 .080 .527 .331 .380 
15 186 .054 .808 .288 .892 -.058 -.026 -.097 .241 .426 .0382 
19 .280 -.161 .218 .529 .246 .112 .268 .278 .504 .358 .425 
20 174 -.005 .109 .545 .167 .141 .264 .292 .419 .194 .310 
21 .270 -.047 .202 .498 .2738 .274 .165 .243 .599 .305 .414 
22 180 .098 .182 .271 .274 .076 .087 .120 .290 .264 .317 
23 174 -—.041 .273 .852 .860 -.016 .230 .286 .879 .3850 .283 
24 258 .041 .229 .880 .153 .180 .153 .190 .456 .3875 .291 
25 .216 -.084 .251 .875 .896 .058 .252 .260 .244 .215 .284 
26 .250 .066 .206 .870 .284 .127 .278 .317 .518 .426 .417 


27 -246 .108 .291 .823 -—125 .096 .070 .403 .352 .380 
28 4 -.246 186 -.042 .026 .134 .089 .033 .068 -.014 —.187 
29 108 .136 147 812 .016 .114 .060 .282 .3899 .182 
30a = .291 -.042  .147 .281 -.020 .801 .270 .597 .381 .442 
82 323 = .026 .812 .281 -.251 .090 .001 .306 .335 .137 
838 -.125 .184 .016 -.020 -.251 022 .055 .095 -.062 .170 
34 096 .089 .114 .301 .090 .022 835 .234 .109 .223 
35 070 .033 .060 .270 .001 .055 .835 .269 .060 .2386 
36 403 -.068 .282 .597 .3806 .095 .234 .269 AT7 = .564 
37 852 -.014 .399 .881 .3835 -.062 .109 .060 .477 267 


38 880 —187 .182 .442 .1387 .170 .223 .236 .564 .267 

39 -.063 .083 .172 .064 .148 .057 .422 .887 .076 .012 .170 
40 .266 -—.071 .297 .580 .279 .186 .249 .3821 .601 .480 .452 
41 027 .201 .285 .152 .874 -.004 .035 -.017 .161 .405 -.096 
42 -.034 .185 .879 .184 .265 .284 .126 .111 .312 .245 .118 
43 039 .279 .852 .128 .177 .824 .166 .116 .316 .193 .069 
dd 184 .151 -.042 .146 .190 .061 .121 .169 .048 .018 .152 
45 -.069 -.053 .010 .033 .198 -.107 -.007 —.048 -.128 .066 -.056 
46 .262 -.101 .0388 .246 .028 .141 .226 .3839 .252 .228 .342 
47 -018 .221 .146 .014 .006 .246 .029 -.009 .038 -.029 -.158 
49 139 .262 .246 .044 .189 .221 .073 -079 .148 .112 .119 
50 -.020 .254 .044 .026 .101 .188 .048 -.028 .167 .071 .130 
51 010 .211 .181 -.012 .200° .221 .014 -.096 .303 .168 .146 
538 -.016 .207 .140 .108 .226 .102 .201 .181 .060 .175 .052 
54 121 .115 807 .108 .811 -—033 .153 .186 .174 .198 —.034 
55 227 .010 .180 .294 .151 .130 .188 .198 .487 .182 .451 
56 103 -.075 .174 .363 .1938 .069 .876 .451 .282 .230 .263 





16 018 .080 .085 -.063 .174 .066 -.075 —.204 -.047 —.031 .000 
30 .284 -.028 .154 (.974) .241 -.010 .281 .266 .574 .363 .410 
31 .281 -.054 .181 (.969) .307 -.080 .305 .259 .586 .3879 .452 
48 -.086 .001 .071 .075 .048 .042 .119 .164 .197 .106 -.031 
52 012 .099 .034 .019 .083 -.023 -.017 -—.122 .076 .032 .112 
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TABLE 1 (continued) 


The Inter-test Correlations 








Speaeneefeeoext = es. 2 lh! Uf 


3 189 .478 .071 .123 .044 .087 .039 .303 -072 .009 .058 
14 .005 .807 .178 .809 .454 .043 .071 .103 .095 .264 .195 
15 -108 .810 .428 .286 .254 .111 .227 .037 .183 .878 .219 
19 168 .493 .0438 .187 .186 -.016 .112 .248 .012 .034 .135 
20 156 .480 .033 .229 .155 .202 -.061 .108 .115 .032 -.022 
21 072 .488 .105 .278 .340 .130 -047 .260 .144 .006 .140 
22 2371 .459 .144 .200 .092 .324 .107 .260 -.082 -.041 -.090 
3 250 .454 .172 .108 .098 .059 .096 .153 -.063 .006 .018 
24 113.443 .162 .265 .267 .125 .094 .418 .040 .091 .140 
25 245 .441 .125 .202 .093 .275 .145 .208 .054 -.031 -.026 
26 327 517 .191 .194 .158 .080 -.035 .161 -.125 .154 .056 
27 -.063 .266 .027 -.034 .039 .184 -.069 .262 -.018 .139 -.020 
28 .083 -.071 .201 .185 .279 .151 -.053 -.101 .221 .262 .254 
29 172 «.297 .235 .3879 .852 -.042 .010 .0388 .146 .246 .044 
80a .064. «5380 «©.152 «184 4.128 .146 03838 .246 .014 .044 .026 
32 148 .279 3874 .265 .177 .190 .198 .028 .006 .189 .101 
33 057 .186 -.004 .284 .3824 .061 -107 .141 .246 .221 .188 
34 422 .249 .0385 .126 .166 .121 -.007 .226 .029 .073 .048 
35 387 .321 -.017 .111 .116 .169 -—048 .339 -.009 -—.079 -.028 
36 076 .601 .161 .312 .316 .048 -.128 .252 .038 .148 .167 
37 012 .480 .405 .245 .193 .018 .066 .228 -.029 .112 .071 
38 170 .452 -.096 .118 .069 .152 -.056 .342 -.158 .119 .130 


3 232 .084 .083 -.016 .077 .074 .033 -.080 .116 -.123 
40 2382 206 .380 .248 .228 -003 .293 .107 .059 .086 
41 034 .206 247 .268 .148 .338 .056 .118 .3826 .127 
42 083 .380 .247 675 .041 .104 .1438 .421 .287 .085 
43 -.016 .248 .268 .675 057 .089 -.002 .475 .342 .180 
44 077 .228 .148 .041 .057 172 .120 -.042 .089 .000 
45 074 -.003 .338 .104 .089 .172 -.065 .041 .175 .039 
46 033 .293 .056 .143 -.002 .120 -.065 -.061 .056 .130 
47 -.080 .107 .118 .421 .475 -.042 .041 -.061 153.071 
49 116 .059 .826 .287 .3842 .089 .175 .056 .153 308 


50 -.1238 .086 .127 .085 .180 .000 .039 .130 .071 .308 

51 -.088 .153 .192 .228 .3890 .048 .089 .017 .1838 .558 .885 
53 264 .257 .277 .350 .262 .290 .862 .055 .183 .150 .020 
54 196 .292 .290 .3852 .842 .277 .283 .040 .208 .159 .070 
55 180 .340 .0386 .216 .195 .034 -.103 .218 .060 .249 .289 
56 315 .465 .099 .267 .168 .198 .071 .840 .078 .019 .034 


16 090 .051 -.027 .104 .014 .157 .024 -.070 .182 .170 -.078 
30 0389 .514 .142 .185 .136 .111 .002 .257 .029 .015 .032 
81 087 .516 .154 .173 .112 .175 .066 .219 -004 .074 .019 
48 062 .166 .050 .170 .063 -149 -.028 .210 .082 .019 .096 
52 -.030 -.109 .010 .087 -.013 .105 -.006 -—.192 -.006 .048 -.019 
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TABLE 1 (continued) 


The Inter-test Correlations 




















- + oe Bee oe ae ae | os. 2 & & 
13 .045 .205 .172 .288 .398 | .015 .884 .341 .178 -.045 
14 .427 .186 .154 .408 .090 ~.003 .268 .211 -.050 .114 
15  .196 .196 .264 .180 .126 068 .245 .217 .007 .006 
19  .050 .086 .082 .811 .317 ~.029 .526 .501 .091 .104 
20 .016 .255 .150 .300 .340 051 .503 559 .124 .098 
21 -105 .098 .284 .264 .234 -.055 .501 .464 .053 .088 
22 051 .293 .256 .219 .859 | 167 .264 .262 .170 .109 
23 -.022 183 .248 .174 .370 ~.075 .871 .810 .148 -.127 
24 227 152 .142 .255 .300 -.053 .379 .358 .198 -.011 
25 -.062 .814 .409 .178 .396 055 .882 .844 .067 .053 
26 287 210 188 .252 292 010 320.402.205.066 
27.010 -.016 121 227 103 | 018 .284 281 -.086 .012 
28 211 .207 .115 .010 -.075 080 -.028 -.054 .001 .099 
29 181 .140 .307 .180 .174 085 .154 .181 .071 .034 
30a -.012 .108 .108 .294 .363 ~.063 (.974) (.969) .075 .019 
32 200 .226 .311 .151 .193 174 241 807.043 .088 
33 221 102 -.083 .130 .069 066 -.010 -.030 .042 -.028 
34 014 .201 .153 .188 .876 -.075 .281 .805 .119 -.017 
85 -.096 .181 .186 .198 .451 -.204 266 .259 .164 —122 
36 803 .060 .174 .487 .282 -.047 .574 .586 .197 .076 
87 168 .175 .198 .182 .280 -.081 .368 .879 .106 .032 
88  .146 .052 -.084 .451 .263 000 .410 .452 -.081 .112 
39 -.088 .264 .196 .180 .315 090 .089 .087 .062 —.030 
40 158 257 292 340 .465 | .051 .514 .516 .166 -.109 
41 192 .277 .290 .036 .099 -.027 .142 .154 .050 .010 
42 228 .850 .852 .216 267 | 104 185 173 .170 .087 
48 .890 .262 342 .195 168 | .014 136 112 .063 -.013 
44 048 .290 .277 .034 .198 157 111.175 -.149 .105 
45 .089 .862 .283 -103 .071 024 .002  .066 -.028 —.006 
46 017 .055 .040 .218 .340 -.070 .257  .219 .210 -.192 
47 188 .188 .208 .060 .078 182 .029 -.004 .082 —.006 
49 558 .150 .159 .249 .019 170 .015 .074 .019 .048 
50 ~—-.885-.020 -.070 -.289 .084 -.078 .082 .019 .096 -.019 
Rl ~.021 .022 .253 -.020 041 -.047 .026 .045 .091 

-.021 683 .112 .386 079.081 .180 .125 -.018 
54 022 .633 110 .308 -.088 .089 .121 .129 -.125 
55 = «253-112-110 276 007.811 .257 .170 -.027 
56 -.020 .836 .308 .276 -.084 .866 .889 .178 -—.203 
16 .041 .079 —088 .007 —.034 -.050 -.073 .197 .159 
30 -.047 .081 .089 .311 .366 ~.050 888 .049 -.030 
81 026 .180 .121 .257 .339 -.073 .888 100 .070 
48 045 .125 129 .170 .178 197 .049 .100 ~.094 


52 091 -.018 -.125 -.027 -.203 -159 -.030  .070 -.094 
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TABLE 2 
The Centroid Matrix 








nH miHviyiwWvvam «x x he 


13 5381 —.325 .093 -.086 -.093 -.027 -.030 -.077 -.098 -.090 438 
14 588 .127 —328 -.075 -.166 -.073 .093 .091 .134 -.089 494 
15 432 3807 —.056 —.348 .166 .046 —.238 -.095 -.176 -.074 537 
19 .578 -.339 -.218 .041 .199 -.106 -.133 —181 .068 .142 624 
20 506 —2385 .086 .044 .119 .111 .134 .179 -.329 -.101 509 
21 .606 —.212 -.211 .076 .249 -.212 .110 -.128 .072 .197 -642 
22 504 —157 .195 ~.128 -.128 -.222 .316 -.133 .082 -.102 533 
23 520 -.241 .182 —183 .124 .059 .051 -.190 -.099 .105 473 
24 .581 -.134 -—.206 .040 -.034 -.142 .048 -230 .182 -—.163 536 
25 553 —175 .807 -.084 .199 -.167 .064 -.085 -.164 .159 569 
26 .604 -—.248 -.014 -.093 -.144 .164 .175 -108 .090 .034 534 
27 .323 —.239 -.206 -—.313 .029 -.088 —090 .3804 .151 .108 445 
28 112 .408 .099 .211 —204 .222 .170 -.147 -.058 .070 383 
29 431 .149 -.039 -.115 .189 .231 .086 —131 .084 .124 342 
30a = .582 —.348 -.076 -.070 .221 .084 -095 .096 -.168 -—.060 576 
32 468 .113 .147 -.436 .151 .087 —056 .047 .053 .216 529 
33 211 .126 -.254 .428 —132 -.126 .278 -.143 -.172 -.096 478 
34 443 -.266 .324 .381 -—170 .325 -.282 .146 .144 .034 174 
35 429 —397 .3852 .453 -.145 .239 —200 .108 .160 -.035 827 
36 .684 -.246 -.400 -.119 .042 .128 .094 .196 .077 .050 -776 
37 .535 —.042 -.172 -.359 .150 .143 -.084 -.189 .185 -.127 583 
38 505 —.389 —.275 -.071 —.226 -.167 .031 .192 -.037 .077 611 
39 800 -.170 .891 .117 -.218 .1389 .156 -.059 .131 .205 439 
40 -732 —.286 -.062 -—.066 .110 .031 .151 -.053 —.133 -.169 685 
41 373 .384 .116 -.272 .057 .146 -.180 -.221 .096 -—.160 515 
42 5384 .380 -.102 .245 .259 .089 .150 .036 .100 —.157 633 
43 510 .501 -.212 .278 .174 .099 .159 .138 .151 -.058 744 
44 276 .043 .807 -.084 -—.126 -.227 .062 .163 -.114 -.112 303 
45 1538 .289 .286 -.201 .052 -.215 -.179 -.039 .093 —.146 342 
46 357 —.278 -.089 .118 —.131 -.226 —.238 -.068 .044 -.190 394 
47 182 .392 -.078 .337 .329 .044 .060 .101 -.111 —.060 446 
49 350 .502 —.180 -.059 -.305 .120 -.196 .032 —112 .164 597 
50 229 .255 -.233 .093 -—.224 -.079 -.250 -.110 -.217 .206 401 
51 316 .421 —333 -—118 -.465 .180 .039 .089 -.068 -.056 668 
53 459 .283 .482 .067 .069 -.230 .079 .087 .059 -.069 607 
54 482 .296 .386 -.030 .235 -.192 .076 .097 .185 .127 611 
55 485 -.092 —.225 .083 -.178 -.047 -.059 .190 -.128 .182 408 
56 5385 —.227 .247 .158 .065 -.037 -.089 .023 -.086 -—.149 467 





1 
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TABLE 3 


The Final Transformation Matrix (A,,) 





a a oe Soe eo ese 


I 28 15 80 42 82 27 24 «38 16 .21 = .04 
II 01 -18 -386 -48 .28 .09 30 30 .22 -.19 -.15 
II 388 86.87 -40 -40 -21 -04 -27 -18 39 09 -.12 
IV 06 § 6.47 -15 -22 538 -14 08 -39 - - -.13 -.10 

















TABLE 4 
The Rotated Factorial Matrix 

No. Test A sp CC CC pp FF Ff ¢ ©» fe 
¢-18 Disarranged Words II 21 .10 .23 37 -.07 .17 .08 .09 .01 .27 -.05 
¢-14 Theme: Rating 11-07 .89 .41 .22 -02 .25 .89 .06 -.03 -—.04 
G-15 Theme: Word Count -.10 -.20 .00 .10 .02 .45 .19 .28 .24 .24 -.09 
G19 Grammar 09 .06 .44 .49 .21 .88 .04 -—01 -—03 .02 .17 
G-20 Verbal Analogies 05 .00 -.01 .22 .21 -.01 .02 .05 -05 .54 .06 
G-21 Spelling .26 -.08 .40 .44 .41 .25 .01 .00 -.01 -.01 .25 
G-22 Suffixes 55 -06 .27 .82 .05 -.02 -03 .19 .08 .06 -.07 
G-23 Anagrams 25 .08 .06 .18 -.02 .81-.04 .12 .05 .25 .17 
G-24 Rhyming 25 .01 46 .47 .20 19 .05 .24 -.09 -.06 -.14 
G-25 Disarranged Words I 88 -02 .07 .19 .14 .27 -.01 -—09 .20 .26 .16 
G-26 Inventive Opposites .26 17 .22 .29 .00 .08 .06 387 -.08 .11 .16 
G-27 Phrase Completion -.12 -05 .47 .52 .00 -.08 .08 .12 .83 01 .19 
G-28 Speech Attitude Scale 20 .15 -386 —41 .10 .01 .23 .24 -18 -.03 .02 
G-29 Speed of Handwriting 07 .05 -.08 -02 .16 .21 .00 387 .02 .01 .21 
G-30a Morpheme Recognition -08 .04 .21 .42 .15 .20-.02 .06 .04 .41 .08 

Letter-Star Test: 
G-82 No. of responses .07 -038 .06 .10 -.01 .26 .02 .80 .42 .08 .25 
G-33 Diversity 27-10 .01 .03 .87 -.05 .25 —01 -.42 .06 -.10 

Paired Associates: 
G-34 Turkish-English -.03 .79 .01 .03 .01 .02 .06 .04 .04 .05 .O1 
G-35 English-Turkish .05 .77 07 .10 .05 -.04 -.03 -—.05 -.02 .05 -.04 
¢-36 Vocabulary -.05 01 48 .55 .25 .01 .11 387 O01 .17 .26 
¢-37 Distorted English -.04 -04 .80 .84 .01 .88 -07 .48 .11 .04 -01 
G-88 Word-Choice 138 -.01 .52 .64 .08 -038 .27 .05 .02 .15 .13 
G-39 Word-Number Memory 388 .41 -.06 -.08 -.07 -.04 .01 .10 .02 -—05 .19 
G-40 Disarranged Morphemes .20 -.04 .28 .42 .22 .15 .00 .25 -.05 .88 -.01 
G41 Similes 01 .02 -.05 -06 -.08 .86 .06 .44 .22 .00 -.20 
I-42 Normal speed of oral reading 05 .04-.01 .00 .62 .08 -02 .82 .02 .03 -.07 
I-43 Maximum speed of oralreading .01 .05 .01 -.02 .67-.05 .10 .87 .04 -.07 .00 
44 Naming states of the Union 28 -.038 .05 .14 .01 -—08 .10 -02 .29 .19 -.17 
l-45 Giving first names 12 -05 .05 .02 -02 .17 .00 .06 .41 -—.07 —.28 
I-46 Memory for homophones 07 12 .48 .48 .00 17 .14 -09 -01 .02 -.27 
1-47 Speed of articulation ~.09 -.04 -.21 -.19 .57 .02 .00 .00 -—.03 .10 -.03 

Picture Description: ee 
1-49 No. relevant words -.02 .05 ~-.06 -.07 .00 .24 .61 .82 .09 .00 .04 
1-50 % relevant words .02 -.02 .08 .038 .01 .85 .58 —02 -.07 .00 .03 
I-51 Rating -.01 -.04 .02 .04 -.04 -.02 .55 .538 -—06 .04 -.06 
153 Form-Naming 41 .10 -02 -01 .29 .01 -01 .04 .41 .02 -.17 
I-54 Color-Naming 28 05 02 .00 .26 09 -—07 .07 .49 -05 .06 
55 Paragraph Memory 05 .07 .25 .85 .14 .05 89 .05 .01 .16 .13 


1-56 _Nonsense Numbers 16 «24 =.12 = 25 15. 13 - 01 -04 .08 .27 -.14 
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TABLE 5 
Cosines of Angles between the Reference Vectors 
- ce ee ee ee ae oe One ae 
A 100 -14 08 02 .05 -02 11 -07 -04 -.15 .05 
B -—14 1.00 -.10 -—22 -.10 -05 -.01 .07 01 -.26 .03 
C 08 -—10 100 ... 007 -04 .08 -01 .27 -—40 -.14 
C’ 02 -—22 ... 100 .05 -02 .06 -04 .22 .00 -.19 
D 05 -1i0 .07 .05 1.00 -18 -18 -.10 .01 -.06 .09 
E -.02 -05 -.04 -02 -—18 1.00 .29 -—12 -.06 .03 .01 
F 11 -01 .08 .06 -.18 .29 100 -.06 -08 .08 .04 
G -07 07 -.01 -.04 -10 -.12 -.06 1.00 -04 -.07 -.02 
H -04 001 .27 .22 01 -.06 -08 -.04 1.00 -—17 -.02 
J -15 -26 -40 .00 -06 .08 .08 -—07 -17 1.00 -.09 
K 05 .038 -14 -19 09 01 .04 -.02 -02 -.09 1.00 
TABLE 6 
Correlations between the Primary Factors 
a. KR, when reference vector C is oblique to J. 
A B C D E F G H J K 
A 1.000 .190 .019 -.022 .073 -.140 .076 .066 .202 -.024 
B 190 1.000 .227 .104 .086 -.058 -.011 -.003 .857 .025 
C 019 .227 1.000 -.052 .056 -.121 .022 -.222 .486  .203 
D -.022 .104 -.052 1.000 .151 .148 124 .087 .044 -.102 
E 073 .086 .056 .151 1.000 -.265 .181 .041 .065 -.001 
F -.140 -.058 -.121 .148 -.265 1.000 .029 071 -.130 -.075 
G 076 -.011 .022 .124 181 .029 1.000 .063 .088 .016 
H 066 -.003 -222 .037 .041 .071 .063 1.000 .067 -.016 
J 202 .857 .486 .044 .065 -—.130 .088 .067 1.000  .157 
£ K ~.024 025 .203 -102 -.001 -—075 .016 -.016 .157 1.000 
b. R, when reference vector C’ is orthogonal to J. 
A B C’ D E F G H J K 
A 1.000 .189 .018 -.022 .073 -140 .076 .066 .216 -.204 
B 189 1.000 .222 .104 .084 -—.054 -.012 -.001 .298 .023 
Cc’ 018 .222 1.000 -.051 .040 -—108 .018 -.221 .048 .200 
D -.022 .104 -.051 1.000 152 148 124 087 .071 -.102 
E 073 .084 .040 .152 1.000 -.268 .180 .045 .048 -.004 
F -.140 -.054 -.108 .148 -.263 1.000 .030 .068 -.090 -.072 
G 076 -.012 .018 .124 .180 .0380 1.000 .068 .087 .016 
H 066 -.001 -.221 .037 .045 .068 068 1.000 .171 -.016 
J 216 .298 048 .071 .048 -.090 .087 .171 1.000 .086 
K 1.000 


-—.024 


023  .200 


—.102 


-.004 -.072 .016 -.016 .086 











10. 


12, 


13. 


14, 


15. 


16. 


17. 
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TABLE 7 


Saturations (a,,) of Primaries in a Second-Order General Factor* 





a. From R, with C oblique to J. 
A B C D E F G H J K 
234 .489 .276 .181 .266 .000 .190 .000 .668 .000 








b. From R, with C’ orthogonal to J. 
A B. © D E F G H J K 
276 .586 .100 .167 .283 .000 .212 .000 .487 .000 








10. 
11, 


12, 
13. 


14, 
15. 
16. 


aq. 


* The saturations of primaries F, H, and K have been arbitrarily set 
equal to zero because of the many appreciable negative correlations in the 
corresponding arrays of Table 6. 
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SYNTHESIS OF VARIANCE 


FRANKLIN E. SATTERTHWAITE 
UNIVERSITY OF IOWA 


The distribution of a linear combination of two statistics dis- 
tributed as is Chi-square is studied. The degree of approximation 
involved in assuming a Chi-square distribution is illustrated for 
several representative cases. It is concluded that the approximation 
is sufficiently accurate to use in many practical applications. Illus- 
trations are given of its use in extending the Chi-square, the Student 
“t” and the Fisher “z” tests to a wider range of problems. 


Introduction 


In the analysis of normally distributed statistics, the variance 
occupies a prominent role. Therefore a knowledge of the distribution 
of the statistics used to estimate the variance is important. The Chi- 
square distribution furnishes an exact method for evaluating the sig- 
nificance of many of the estimates in common use. Thus, to deter- 
mine the significance of an estimate of variance, 


Sis - 2)* 


n—1 


2— 


qr 


’ 


we enter a table of the Chi-square distribution with 


(n — 1)? _ ear 2) 
o ‘e o 


and n — 1 degrees of freedom. We shall call estimates so evaluated 
simple estimates of the variance. However, in practical problems the 
best estimates available are often not simple estimates but are given 
by a linear combination of two or more simple estimates. We define 
such estimates as complex estimates of variance. In general, the Chi- 
square distribution does not give an exact test for a complex estimate 
of variance. The purpose of this paper is to give an approximation 
to the distributions of complex estimates of variance which is based 
on the Chi-square distribution and which is usually accurate enough 
for practical use in Chi-square, Student “t,” and Fisher “z” tests. 
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Mathematical Development 


Let x and y be two independent simple estimates of variance with 


expected values z and y, and with degrees of freedom 7, and r.. By 
transforming the formula for the Chi-square distribution, we obtain 
for the distribution of x, 


fila) =a (a, geen erat 

T/2) |= 
and a similar distribution, f.(y), for y. The distribution function of 
z=2x + y will then be 


Fe) = [A@) f(z — x) dx 


Zz A A 
== BE cls b- —| —0(2- 
=K { x3 (z — g) 1 e-ar/e-vi2-2)V ye 
0 


where a = r,/2, b = 7./2. If we now specialize our distribution to 
the case where r, and r, are both even integers, we can expand 
(z — x)° by the binomial theorem and integrate on x by parts. The 
resulting function of z is a linear function of several Chi-square func- 
tions which when integrated gives for the probability that z will be 
greater than some fixed value, w, 


1 (—1)i(ati-1)! [va \e bd \i 
Pe>«)=E—e=t —(g) G) 


i=0 zx y 





Plax? > 2bw/y,2(b—i)df.] (a+b—j-—2)! 
[a/é — b/yy™ fo (6—t—1)i(at+i—-j—1)! 


(¢ ‘me (2 ito > 2aw/z,2(a+b—j- ce 
x y [a/a — b/ y]* 

It is readily seen that, even for the simplified case here consid- 
ered, the exact distribution of z is too complicated for practical use. 
We shall therefore approximate the distribution of z by use of a Chi- 
square distribution with 7 degrees of freedom. To determine r we 
impose the condition that both the theoretical and the approximate 
distributions of z shall have the same variance. On calculating the 
second moments about the means of f,(x) and f.(y), the variances of 
the distributions of x and y are found to be 
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Similarly, the variance of the approximate distribution of z is 
2 _ (e+y)* 


CG; 
. T r 


Since the variance of a sum of independent variables is equal to the 
sum of the variances, we therefore have, 
o," = oO" + oy” 
or 
Gey 7 ¥ 
ee ER Sl = ee ee 
r i ie 


y 


from which we may determine the effective number of degrees of 
freedom, r, of the approximate distribution of z. In practice, the 
expected values, « and y, are usually unknown and are estimated by 
use of x and y. 

In Figure 1 we have plotted both the exact and the approximate 
distributions of z for several values of the parameters. In each in- 
stance the agreement appears to be satisfactory enough for purposes 
of testing significance. On the basis of the few values so far inves- 
tigated we should not be justified in making any general statements 
regarding the degree of approximation involved. However, from gen- 
eral reasoning we should expect the approximation to improve in the 
following situations: 

1. As the 7’s increase, since both the exact and the approximate 
distributions approach the same normal distribution with the in- 
crease in the number of degrees of freedom. 

2. As the ratio r,y/r.x approaches unity, because the approxi- 
mate and the exact distribution formulas are identical when this ra- 
tio is unity. 

In general, the theoretical distribution is flatter topped than the 
Chi-square approximation. If we are going to use the approximation 
in a Chi-square test, we are interested in the upper end of the dis- 
tribution and our rule slighly overestimates the best number of de- 
grees of freedom to use. If for distribution (C,) in Figure 1 we had 
assumed 5.9 effective degrees of freedom instead of 7.7 effective de- 
grees of freedom, the approximate distribution would have been the 
dashed line, (C.), and the theoretical would have been given by the 
associated dashed curve, a very close agreement at the upper end of 
the distribution. For the Student “t” test we are interested in the 
lower end of the Chi-square distribution (which affects the upper end 
of the “t” distribution) so that our rule slightly underestimates the 
effective number of degrees of freedom. In Figure 1, the dashed line, 
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(C;), gives the approximation to the C distribution based on 9.0 de- 
grees of freedom instead of the 7.7 given by the rule. The correspond- 
ing theoretical values given by the associated dashed curve show a 
very good fit at the lower end. For a Fisher “z” test our rule slightly 
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The exact distributions of the complex estimates of variance listed below are 
plotted on the chart as horizontal curved lines. The chart is so designed that any 
horizontal straight line corresponds to a Chi-square distribution with the num- 
ber of degrees of freedom given by the vertical scale. The approximation sug- 
gested in this paper is given by the straight line tangent to the theoretical dis- 
tribution. The degree of approximation may be measured numerically by follow- 
ing along lines of constant Chi-square. For example, a Chi-square of 16 for the 
(EZ) estimate of variance corresponds to a theoretical probability of 1% as is 
given by point, a, on the chart. However, if one uses the approximate distribu- 
tion, he would read the point, 8, obtaining a probability of 0.8% instead of the 
correct value of 1%. The distributions plotted are for complex estimates of vari- 
ance with the following parameters: 
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overestimates the effective degrees of freedom in the numerator and 
underestimates them in the denominator. No attempt has been made 
to estimate the foregoing adjustments without actually calculating 
the theoretical distribution. However, they are apparently of small 
enough magnitude to have little effect on the conclusions drawn in 
significance tests. 

The analysis above is readily extended to the case when z is a 
linear function of several simple estimates of variance. If 


ZA, + Ant, ++: 


where x; has the expected value, z;, and its distribution has rT; de- 


grees of freedom, then rz/z is approximately distributed as is Chi- 
square, with r degrees of freedom, where r is determined by the equa- 


tion, 
A,X, + Act, +++)? £1)? Zo)? 
(0,7, + AX, ) sia (a, 2) 4 (A.% 2) Bow (1) 
r rT, 1. 





If some of the a’s are negative, special care should be exercised in 
using the x’s to estimate the 2’s in (1). If the true value of 7 is small, 
major errors may result from such an approximation. Also the theo- 
retical distribution in this case is not necessarily flatter topped than 
the approximation so that the foregoing remarks regarding the de- 
gree of approximation do not apply. 
Applications 

The first application we shall make is to the Student “t” test of 
the significance of the difference of the means of two samples. The 
usual estimate of variance used in this test is, 


52o 3S (aay — %1)* + Sees — a)? Vw i Ai 

N,+N.-—2 Ne fe 
with N, + Nz — 2 degrees of freedom. The use of this estimate is 
based on the assumption that both samples were drawn from normal 
populations with the same variance. Frequently we do not have suf- 
ficient evidence to justify such an assumption of homogeneity of vari- 
ance, and sometimes we have definite evidence of a lack of homogene- 
ity. To avoid making such an assumption we can use as an estimate 
of the variance of the difference, 
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We have shown that while the use of such complex estimates of vari- 
ance in Student “‘t’” tests is not strictly correct, the probabilities cal- 
culated are approximately correct when the number of degrees of 
freedom, 7 , is calculated from equation (1). Thus 


ost (a:2/Ni)?_, (a22/Ne)? 
7 (,-1) W,-1)- 


The technique presented in this paper appears to have wide ap- 
plication when we are dealing with data subject to what we shall call 
“random classification.” For example, if we are studying students 
and classify them according to schools, we have a random classifica- 
tion if the particular schools entering into our experiment are con- 
sidered to be a random sample from a population of schools. On the 
other hand, if we classify the students by methods of teaching, we do 
not have random classification because the primary object of study 
is here the particular methods used, not some population of methods. 

To illustrate the application of our theory to random classifica- 
tion, we shall examine the variance of certain normally distributed 
data, #i;, ((=1,2,---,a;7=1,2,---, b) which fall into classes 
identified by the subscript, 7. We assume that there is significant 
variation between classes. Letting m; be the expected value of the z’s 
in the ith class, we assume that the m,’s are normally distributed 
about a mean m. The following table lists the different variances 
entering into this problem with the corresponding estimates indicated 
by a wave, (~). 





0:2 = variance of (x; — mi); 
a2 = DB (xi; — %;)2/a(b — 1). 
o.? = variance of (x; — m) = (a; — mi) + (mi—™m); 
on? = 5 (2; — %)?/(a— 1). 
o;? = variance of (x; — mi); 
o;?=0,2/b. 
o.2 = variance of (m; — m) ; 
0.2 = 022 — 6;7/b since on? = a3? + 0,2. 
We see that o,? is the true variance between classes and that its esti- 


mate is a complex estimate. If we should desire to use o,2 in a sta- 


tistical test, we may assume that 7,0,2/0,2 is distributed approximate- 
ly as is Chi-square with r,, the number of degrees of freedom, deter- 
mined from equation (1). Thus. 
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oe (0,2/b)? 


T,  @—-1 a(b—1)° 





Given the data above, we frequently want to determine confidence 
limits within which we may expect an additional item in a new class 
(i.e., Zau,;) to fall. Two additional variances enter into this problem, 


namely, | ; 

os? = variance of (% — m), 

057 = o27/a, since x is an average of the %;’s; 

oe? = variance of (2a+,; — £) = (Xan j — Man) 

+ (Man — m) — (x — m) ; 
O62 = 017 + (02? — o:2/b) + 02/a 
= (1—1/b)o,2 + (1+ 1/a)o,*. 

The appropriate number; 7,; of degrees of freedom for the approxi- 
mate distribution of o,2 is obtained from equation (1). Thus, 

oe [(1—1/b)o7]? | [(1 +1/a)o,"]? 

.  we>-y a-1 


Then, determining the value of the Student “t” for the desired con- 
fidence level and 7, degrees of freedom, we should expect %a.:,; usually 
to fall within the limits, 





%— toe < Xan <U+ ta. 


For our last example we shall take two groups of students, x; 
and yi;, each group being classified according to instructor. The 
instructors in the x group each used a different teaching method 
while those in the y group all used the same method. We should 
like to determine whether or not the differences observed between 
the methods in the x group are significantly greater than would 
have been expected because of variation in the ability of the instruc- 
tors. We therefore compare by use of the Fisher “z’ test the esti- 
mate (o,? above) of the true variance between instructors for the x 


group with the corresponding estimate for the y group. Since o,? is 
a complex estimate of variance, the appropriate number of degrees of 
freedom must be determined from equation (1). 
Conclusion 

This paper gives an extension of the Chi-square, Student “‘t,” and 
Fisher “z’’ tests to situations where the Chi-square distribution does 
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not give an exact evaluation of the estimates of variance used. This 
condition arises wherever the variance of a statistic can not be esti- 
mated directly but must be estimated by a linear function of two or 
more independent estimates. The analysis of variance provides us 
with a powerful method for splitting the variance of a statistic into 
its elementary factors. The synthesis of variance provides a method 
for constructing the variance of complex statistics out of such ele- 
mentary factors. 


Historical Note 


The problem treated in this paper has been recognized by R. A. 
Fisher and others, particularly in connection with testing the sig- 
nificance of the difference between means. R. A. Fisher suggested a 
method of solution as an illustration of fiducial theory. B. L. Welch 
compared several suggested approximations and illustrated their bias 
as compared with the approximation used in this paper. He did not 
investigate the accuracy of the approximation here used. P. L. Hsu 
investigated the problem from the standpoint of errors of the second 
kind (Pearson-Neyman theory). He found the general distribution 
of (x, — %2)/og [equation (2)] which, as we would expect, is very 
complicated. Where comparable he confirmed the conclusions of 
Welch. 
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ON THE MUTUAL INFLUENCE OF INDIVIDUALS 
IN A SOCIAL GROUP 


N. RASHEVSKY AND ALSTON S. HOUSEHOLDER 
THE UNIVERSITY OF CHICAGO 


A previous mathematical study of a situation, in which the be- 
havior of a larger group of individuals is controlled by a smaller 
group, is generalized for the case when the “activity” of the indi- 
viduals in the group is continuously graded. The existence of two 
possible social configurations and of sudden transitions from one 
configuration to another are found in this case also. 


In a previous paper (1) we have discussed the hypothetical case 
in which a social group consists of a relatively small number of “ac- 
tive” individuals and a larger number of “passive” ones. The former 
are characterized as exhibiting always a definite type of behavior, 
regardless of the behavior of others. The latters are those whose be- 
havior is determined by the behavior of the majority of the social 
group. Considering that the active individuals are divided into two 
groups, characterized correspondingly by behavior A and E,, we es- 
tablished and studied the equations which govern the behavior of the 
passive individuals under the competing influence of the two active 
groups. 

It has been emphasized in the previous paper (1), that such an 
assumption of a sharp division into active and passive individuals is 
made only as a convenient approximation. Actually there are con- 
tinuous gradations between the two groups. The purpose of the pres- 
ent paper is to investigate a relatively simple case of such gradation. 

As usual, a generalization of our previously studied case is not 
unique. Several different more general cases may give the same type 
of limiting case. We must therefore choose more or less arbitrarily 
one of several possibilities, without any prejudice to other possibil- 
ities to be studied later. 

Let us consider that every individual has a tendency to the activ- 
ity A , measured by a coefficient a < 1. The quantity 1 — a measures, 
then, his tendency for the activity B. If a= 1 the individual’s ten- 
dency for A is maximum and that for B is zero. Let the population 
be characterized by a distribution function N(a) da, giving the num- 
ber of individuals having an a between a and a + da. We have 


Si N (a) da=N, (1) 
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where N is the total population. 

Denote by «(a@) da the number of individuals with a given a who 
exhibit behavior A. Denote by y(a) da the number of individuals 
with a given a exhibiting behavior B. We have 


y(a) =N(@) — x(a). (2) 


In general, we must assume that the amount of influence that an 
individual exhibiting behavior A exerts towards an increase of be- 
havior A in others is itself a function of a. An individual having 


a= 4 who is completely indifferent as to the choice of behavior A or 


B , if he chooses a given behavior due to the influence of others, will 
himself exert hardly any influence upon others. On the other hand, 
an individual with a = 1 will not only choose behavior A of his own 
initiative, but will exert a strong influence upon other individuals to 
choose the same behavior. Similarly, an individual with a = 0 will 
not only choose of his own initiative behavior B , but will strongly in- 
fluence others to choose that behavior. For simplicity, we shall choose 
for the amount of influence of an individual the expression 


(1 — 2a)? (3) 


Expression (3) is everywhere positive, is zero for a = 5° and is also 


equal to 1 for a= 0 or for a= 1. Accordingly we consider that an 
individual, characterized by a given a and exhibiting behavior A, in- 
fluences other individuals to choose A to the extent 


fa(a) =a(1 — 2a)?, (4) 


while an individual with the same a, but exhibiting behavior B, in- 
fluences other individuals to choose B to the extent 


fe(a) = (1 — @) (1 — 2a)?. (5) 


oily : 1 . 
Thus an individual with a = °) does not exert any influence one way or 


another, as stated before. An individual with a = 1, when perform- 
ing activity A , influences others to perform A in the amount a. An 
individual with a = 1, but performing activity B , does not influence 
others to perform B at all. This is psychologically plausible. For an 
individual with a = 1 can perform B only under duress, since it is 
contrary to his inclinations, and he certainly will not attempt to in- 
duce others to do the same thing. 
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As stated above, individuals with a = 1 always exhibit behavior 
A regardless of what others do. Since, mathematically speaking, the 
number of such individuals N(1) da is infinitesimal, even if N(1) is 
large, we must consider that all individuals whose a lies between 1 
and 1 — A, where A is a small quantity, always exhibit behavior A , 
regardless of the behavior of others. Similarly, all individuals with a 
lying between 0 and A always exhibit behavior B. The quantities 


Si,v(@) da and Jsp[N(a) — x(a)] da (6) 


play the role of x and y, of the previous article (1), respectively. 
With these assumptions we may set, by an argument similar to 
that used on page 223 of the earlier paper, 





rt Ji @ (1 — 2a’)? x(a’) da’ 
of) oes aes i ous capaliadit Saat (7) 
J? (1 — @) (1 — 2a’)? [N(@’) — «(a@’)] da’, 
Since the integrals are constants, independent of a, putting 
X= f14(a)da (8) 
we have: 
dx Te ; salle 
, J) U (1 — 2a’)? x(a’) da 
Pagid" (9) 
— f2(1 — @) (1 — 2a’)? [N(a’) — x(a’)] da’. 
Ai all times, however, we have 
x(v’)=—N(a@) for 1—A<a<l; 
(10) 


x(a’) =0 for 0<a<4. 
Otherwise x(a’) is determined only by the initial conditions. 


If N(a) is symmetrical with respect to a = 4 so that N(a) = 


N(1— a), then if for t=0, x(a’) = 0 everywhere in the interval 
0 — (1 — A), the first integral of (9) is less than the second for t = 0. 
For the first integral is then equal to 


k, = f1, a (1 — 20’)? N(a’) da’, (11) 
while the second may be written as 
k, = fA(1—a’) A — 2a’)? N(a’')da’ + 


+ f2-4(1 — a’) (1 — 20’)? N(a’) da’. (12) 
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Because of the symmetry of N(a’), k, is equal to the first integral of 
(12), the second being always positive. Hence k, < k,. In that case, 
according to (7) and (9), X can only decrease for all a< 1 — 4. 
Hence all individuals with a < 1 — A will continually exhibit be- 
havior B. Similarly for a symmetric N (qa), if at the beginning x(a’) 
= N(a’) everywhere in the interval 4 — 1, we find that such a situa- 
tion remains unchanged. Hence, as in the previous paper for a sym- 
metric N(a) [corresponding to %) = Yo, % = ¢ in (1)] we have two 
possible configurations, either a behavior A by almost the whole group, 
or behavior B. 

The following consideration emphasizes still more the analogy 
with the former results. Since (7) is independent of a in the right 
member, x(a, t) consists of two components 


x=2x,(a) + x2(F) 
where the first component is independent of ¢ and the second of 4. If 
I,= fi (1 — 2a)?(1 —a)N(a) da, 
I, = fa(1 — 2a)? x,(a) da, 
the latter being a functional J,(27,), and 
i={,—i,, 
then J is independent of a and of t, though J is also a functional of x,, 


and (7) becomes 


dz, __1 
It is no restriction to suppose that x.(0) = 0 and hence that ~, (qa) 
gives the initial distribution. Hence 


%2=3 1 (e* — 1). (13) 


The increase is exponential and is in favor of A when I > 0, in favor 
of BwhenI <0. 

Equation (13) is analogous to equation (21) of the earlier 
study (1). 

If N(a) is asymmetric, then the whole situation may change. In 
that case k, is not necessarily smaller than k,. Let the asymmetry be 
favoring large a’s, so that N(a) < N(1—a) fora < 1/2. Denote 
the two integrals of (12) by k; and k,, respectively, so that 


Lk, +h. (14) 
We now have 
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& >h,. 
If 
k,—k,>k,, (15) 
then 
k, > ke, (16) 


and x(a) will increase everywhere, except for a< A. But an increase 
of x(a) reduces k, and increases k, , thus further enhancing inequality 
(16). Hence the increase of x«(@) will continue until all individuals, 
except those with a < A, exhibit behavior A. Thus (15) is the condi- 
tion for the group to pass from the behavior B into behavior A. Con- 
dition (15) may require actually a very small asymmetry, if N(a@) is 
large only in the immediate neighborhood of a = 14, where (1 — 2a’)? 
is very small. For in that case k, is a small quantity and a very slight 
asymmetry of N(a@) will result in (15). But always there is a thres- 
hold value for the necessary asymmetry. 

By a similar argument we find that an asymmetry of N(q@) in 
favor of smaller a’s, if exceeding a threshold value, will result in be- 
havior B for the whole group, except for individuals with a > 1 — A. 
Those results are essentially identical with the results of the more 
restricted treatment of (1). 

More complicated relations may be studied by considering the 
case of different susceptibility of the different individuals to the in- 
fluence of others. We may, for instance, consider that the suscepti- 
bility of an individual to the influence of others exhibiting behavior 
A is proportional to the value of a of that individual, while his suscep- 
tibility to the influence of others exhibiting behavior B is proportional 
tol — a. We shall then have instead of (8): 


dx (a) 
dt 





=@ Ju’ (1—2a’) 2a (a’) da’ — (1—a) S2(1-@’) (1—2a’)2 X 


[N (a’) — x(a’)]da’. (17) 
Investigations of this and other possible more complex cases 
must be left to another study. 
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THE FACTORIAL INTERPRETATION OF TEST DIFFICULTY 


GEORGE A. FERGUSON 
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This paper discusses the influence of test difficulty on the corre- 
lation between test items and between tests. The greater the dif- 
ference in difficulty between two test items or between two tests the 
smaller the maximum correlation between them. In general, the 
greater the number of degrees of difficulty among the items in a test 
or among the tests in a battery, the higher the rank of the matrix of 
intercorrelations; that is, differences in difficulty are represented in 
the factorial configuration as additional factors. The suggestion is 
made that if all tests included in a battery are roughly homogeneous 
with respect to difficulty existing hierarchies will be more clearly de- 
fined and meaningful psychological interpretation of factors more 
readily attained. 


The presumption underlying recent developments in the theory 
of test structure is that the greater a test’s internal consistency the 
greater its efficacy as an instrument for the measurement of mental 
ability. By internal consistency is meant that every item should cor- 
relate as highly as possible with every other item and as highly as 
possible with the test as a whole. The more closely this condition is 
satisfied the more closely the test approximates to the measurement 
of a unit trait. A test may be regarded as measuring a unit trait in 
the ideal case when the matrix of inter-item correlations is of rank 
1 and when no specific variance other than error variance is found in 
the factorial configuration describing the inter-item correlation ma- 
trix; that is, all inter-item correlations when corrected for attenua- 
tion are in the neighbourhood of unity. Scrutiny of formulas for the 
correlation of sums indicates immediately that the more closely a test 
approximates to the measurement of a unit trait the greater its vari- 
ance and the greater its reliability. 

If the criterion of internal consistency, as I understand it, is to 
be reasonably approximated, the items in a test must be homogeneous 
with respect to difficulty, the difficulty of an item being described by 
the proportion of persons in a clearly defined population who pass it. 
Furthermore, the items must be homogeneous with respect to con- 
tent ; that is, all the items in the test must be of the same type. Rele- 
vant to the foregoing considerations is the observation that although 
in a given test the conditions above may seem to be fairly well satis- 
fied the test may not be a satisfactory measuring instrument for 
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some specified purpose, since if all the items are of equal difficulty 
high discrimination may be secured at one particular level of ability 
at the expense of discrimination at other levels of ability. 

Now the essential problem with which this paper is concerned is 
that if the items in a test, or the tests in a battery, are homogeneous 
with respect to content but heterogenous with respect to difficulty, 
the matrix of item intercorrelations, or test intercorrelations, will 
have a rank greater than 1, and cannot, therefore, from the factorial 
point of view be regarded as measuring a unit trait; indeed, it would 
seem that the greater number of degrees of difficulty the higher the 
rank of the correlation matrix. 

Consider firstly the influence of difficulty on the correlation be- 
tween two test items. The variance of a single test item is given by 


8?= 7 di (1) 


where p; is the proportion of persons passing item 7, and q; is the 
proportion of persons failing item i. The correlation* between two 
dichotomously scored test items is given by 
__Dij — DiPj 

yo 3; 8; ? (2) 
where p;; is the proportion of persons passing both items i and j. 
When p; = p;, the correlation 7;; has a maximum value of unity. 
When, however, p; > p; the quantity p;; has a maximum value equal 
to p; , and the maximum value of 7;; is given by 


PiQi 
oa, (3) 

To illustrate: if p; = .70 and p; = .30, the correlation between 
two such items can never exceed .4286. In general, we may state that 
the greater the difference in difficulty between two test items, the 
smaller the maximum correlation between them. 

Consider now a hypothetical test of m items arranged in ascend- 
ing order of difficulty. Let the difficulty of the items be 7, , eo ,-++ , Dn- 
Let us assume that the x persons passing the ith item are the x per- 
sons making the x highest scores on the whole test of ~ items. Under 
this specified condition p, > p. > p; > +++ > pn, and Piz = Po, Dis = 
as follows: 

Ds 5 *** 5 DPinayn = pn. Therefore, the item covariance pi; — pip; = 
1;Qi, where p; > p;. The matrix of inter-item covariances is then 
* The ¢orrelation coefficient used to indicate the relation between two dichot- 


omously scored test items is arbitrary. The formula given here is identical with 
the coefficient ¢ commonly used in dealing. with fourfold point surfaces. 
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TABLE 1 
1 2 3 4 n 
1 P39; P29, P39, P41 i ae PaQ 
2 P29 P2Qe P39 1 Pan Pe 
3 Ps, 3G Pgs PQs PGs 
4 P4Q; PW P4Qs Put, °° °° Pu 
n Py Py Q PnQs Png *'** PnWn 


This covariance matrix will be observed to possess certain un- 
usual properties. All tetrad equations formed from elements all of 
which lie on one side of the principal diagonal are zero, while all 
tetrad equations formed from elements which lie on both sides of the 
principal diagonal are not zero. All tetrad equations which include 
one of the elements in the principal diagonal, the item variances, are 
zero, while those which include two diagonal elements are not zero. 
The matrix of inter-item correlations will exhibit the same proper- 
ties as the covariance matrix. Consider a numerical example. Let 
the following represent the answer pattern of a test of 8 items ad- 
ministered to a sample of 20 persons, and assume that the score x of 
each hypothetical person is made up of correct responses to the x 
easiest items on the test. It should be noted that with real data this 
condition is never satisfied but is only approximated in greater or in 
less degree. I have specified this condition in order to study with 
greater clarity the properties of inter-item correlation matrices. With 
real data the same properties are manifest but in a blurred form. Let 
the following be the fictitious answer pattern where the rows, Q,, 
refer to items, and the columns, C, , refer to persons. 


TABLE 2 
C, C, C; C, C; C, C,C, C, Cro Ci, C1. Cis C,,C,; Cr6 C,, Cis Cry Coo 
Qe CSP SS eS oe ee 44 
eee oe ee a oe oe er a i vor a 
a ae ae Tx a eee ee ee ee ' 
eh ee 2h es Vo A ae ee 
— ss 2 ee f ee 
ma Si eee. s 
Oi ge fers, 
Be: Bo) 


The table of inter-item correlations obtained from this answer 
pattern is as follows: 
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TABLE 3 


1 2 3 4 5 6 7 8 
1 1.0000 .5461 .3504 .2810 .1873 1326 .0964 .0765 
2 5461 1.0000 .6417 .5145 .3480 .2426 .1765 .1400 
3 3504 .6417 1.0000 .8018 .53845 .38780 .2450 .2182 
4 2810 .5145 .8018 1.0000 .6667 .4714 .3430 .2722 
5 1873 =.8480 Ss 53845 = «6667 «1.0000 .7071 .5145 .4082 
6 13825 .2425 .38780 .4714 .7071 1.0000 .7276 .5774 
7 0964 .1765 .2750 .3480 .5145 .7276 1.0000 .7935 
8 0765 .1400 .2182 .2722 .4082 .5774 .7985 1.0000 


By inserting 1’s in the diagonal of the above correlation table all 
tetrad equations that include one diagonal element are zero. Observe 
that the greater the difference in difficulty between two test items the 
smaller the correlation between them. 

The above correlation matrix with 1’s in the diagonal cannot be 
described exactly in fewer factors than tests; that is, each degree of 
difficulty appears in the factorial solution as an additional factor. If 
the above matrix is factorized by Thurstone’s method, or by the more 
efficient method of weighted summation described by Burt, all factors 
after the first are bipolar and are exemplary of the principle of dichot- 
omous classification ;* that is, the second factor loading of any item 
is a measure of the deviation in difficulty of that item from the aver- 
age difficulty of all the items. The third factor represents a further 
dichotomization, each loading representing a deviation in difficulty 
from the average difficulty of those items that had been described as 
being either above or below the average difficulty by the second fac- 
tor. The remaining factors represent further dichotomizations. 

With real data a much smaller number of factors will describe 
the correlations reasonably well. 

Another solution, which is of course always possible and in this 
case results in all loadings being positive, is based on the assumption 
that the easiest item has a loading in a single factor, the next easiest 
loadings in two factors, and so on until the most difficult item has 
loadings in as many factors as there are degrees of difficulty. 

The discussion above relates essentially to test items, and the 
concept of correlation between dichotomously scored items is arbi- 
trary. It may, however, be demonstrated that similar arguments ap- 
ply also to tests. 

The correlation between a test z, of , items and another test 
2 Of ”, items may be written as a complex function of item variances 
and covariances as follows: 


* Cyril Burt. The factors of the mind. London: University of London Press, 
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m he 





2 = Tix $i Sx 
es =1 K=1 
i rt Ia fy (hy-1) he hy (hg-1) (4) 
/| 2 a 3 78:8) |] Bar +> 2M 848 | 
i=1 #=1 jel i#j k=1 |; ae | 


This formula functions exactly when the item variances and 
inter-item correlations are calculated by formulas (1) and (2), re- 
spectively. 

Examination of the formula (4) renders it apparent that the 
greater the difference in difficulty between the items on z, and the 
items on z the smaller the term in the numerator becomes; conse- 
quently, in general, the greater the difference in difficulty between 
the two tests the smaller the maximum correlation between them. I 
have not attempted rigorous proof of this observation. A rigorous 
proof, if it is possible at all, will be somewhat complex since the dif- 
ficulty of a test is a function not only of the mean score but also of 
the variance of the difficulty values, both of which are in part deter- 
miners of the variance of scores. 

To test the foregoing observation, an answer pattern of the 
scores of a representative sample of 11-year-old children on a Moray 
House verbal intelligence test was constructed by assigning a row to 
each item and a column to each person. The number in the sample 
was 108. The items on the test were reasonably homogeneous with 
respect to content, but heterogeneous with respect to difficulty. The 
test was then divided into six sub-tests ranging from easy to diffi- 
cult, and the score of each child on each sub-test obtained; that is, 
the items were classified according to difficulty, and the scores of each 
person on each group of items was obtained. 

Table 4 gives the average difficulty value, mean score, and num- 
ber of items in each sub-test. 


TABLE 4 
Average 
Test difficulty Mean n 
value 
1 .666 10.66 16 
2 524 8.90 17 
3 423 7.19 17 
4 316 5.38 17 
5 .218 3.71 a7 
6 106 1.69 16 


The intercorrelations are given in Table 5. 
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TABLE 5 
1 2 3 1 5 6 
: er es 8589 8072 8054 -6070 3663 
2 ODEO csvenss -7965 8210 6794 4709 
3 8072 MDT) cece 8685 8019 6712 
Bt 8054 8210 8685... 7951 6794 
5 6070 6794 8019 qa0k |  Gace.. 7807 
6 3663 4709 6712 6794 T80T ——easeeese 


This matrix exhibits properties similar to those found in the 
fictitious matrix of Table 3. The general tendency is for the corre- 
lation between any two tests to decrease with increase in the differ- 
ence in difficulty between them. 

The tetrad equation formed from elements all of which lie on 
either side of the principal diagonal are nearly zero, while equations 
formed from elements which lie on both sides of the principal diag- 
onal differ substantially from zero.* 

The matrix of Table 5 was factorized by the Thurstone method. 
Table 6 gives the centroid solution. 


TABLE 6 


I II h2 
8338 4522 8997 
.8690 .2990 8446 
9288 0097 8628 
9373 0258 8792 
8646 -.2570 8136 
-7299 = -.5297 8133 


amor OD 


* Precisely the same type of matrix results = prs of different ability or 
groups of persons of different ability are correlated. To demonstrate this an an- 
swer pattern was constructed for 216 persons for the test used in the enquiry 
above. These 216 persons were divided into six ability categories of 36 persons 
each. The persons making the 36 lowest scores were placed in Group 1, the per- 
sons making the next 36 lowest scores in Group 2, and so on. Each group of per- 
sons was correlated with every other group of persons; that is, instead of corre- 
lating the scores made by the same persons on different groups of items, I corre- 
lated the scores, as it were, made by the same group of items on different groups 
of persons. The resulting matrix of intercorrelations was as follows: 


: 2 3 4 5 6 


a eee 8105 ..7615 .6986 .5286 .5207 
2 Ure 8504 .7993 .6763 .5736 
3 -7615 .8504 _........ -8857 .7860 .7008 
4 6986 .7993 .8857 _ ........ 9013 .8206 
5 5286 .6763 .7860 .9013 _ ........ 8945 
6 5207 .5736 .7008 .8206 .8945 _........ 


This matrix of intercorrelations between groups of persons of different abil- 
ity exhibits the same essential properties as the matrix of correlations between 
groups of items of different difficulty. By inserting elements in the diagonal that 
conform to the general pattern of the matrix and factorizing, two factors are 
found to be sufficient to explain the correlutions, the first a general factor and 
the second a bipolar factor, which represents the deviations in ability of each 
group of persons from the average ability of the whole group. 
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Two factors were sufficient in this case to account adequately for 
the observed correlations. 

No interpretation must be attached to factors thus isolated which 
is in any sense comparable to the meaningful interpretation frequent- 
ly attached to factors by observing the content of the tests used in 
the battery; that is, factors thus isolated cannot in any sense be asso- 
ciated with functional unities of mind, but must be regarded purely as 
descriptive parameters. The second factor in the above pattern is a 
difference factor and represents a difference in difficulty between a 
particular test and the average difficulty of all tests. With more tests 
in the battery representing a greater number of degrees of difficulty, 
possibly more than two factors would be required to describe the cor- 
relations. These factors would proceed according to the principle of 
progressive dichotomization. 

Now it is usually the custom among factorists, at least among 
factorists of the Thurstone school, to rotate the centroid solution into 
a configuration which is presumed on the basis of certain criteria to 
be psychologically meaningful, and these rotated factors are associ- 
ated in some sense or other with what are regarded as functional 
unities or primary abilities. The functional unity which a given fac- 
tor is presumed to represent is deduced from a consideration of the 
content of tests having a substantially significant loading in that fac- 
tor. As far as I am aware, in attaching a meaningful interpretation 
to factors the differences in difficulty between the tests in a battery 
are rarely if ever given consideration, and, since the tests used in 
many test batteries differ substantially in difficulty relative to the 
population tested, factors resulting from differences in the nature of 
tasks will be confused with factors resulting from differences in the 
difficulty of tasks. 

It may be argued that from the factorial viewpoint no essential 
distinction need be made between these two aspects of a task and that 
as far as the factorist is concerned a difference in difficulty is a diff- 
ference in kind. It would seem, however, that factors deduced from 
test batteries which are homogeneous with respect to difficulty, al- 
though heterogeneous with respect to content, would lend themselves 
more readily to psychologically meaningful interpretation than fac- 
tors deduced from test batteries which are heterogeneous with re- 
spect to both difficulty and content. Furthermore, I suggest as a ten- 
tative hypothesis that when the battery is homogeneous with respect 
to difficulty, not only will existing hierarchies be more clearly defined, 
but also in general the rank of the correlation matrix will be less than 
had the battery been heterogeneous with respect to difficulty and con- 
sequently fewer factors will be required to describe the correlations. 
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On viewing Thurstone’s psychophysical scale from the point of 
view of the mathematical theory of one-parameter continuous 
groups, it is seen that a variety of different psychological or statis- 
tical assumptions can all be made to lead to a scale possessing sim- 
ilar properties, though requiring different computational techniques 
for their determination. The natural extension to multi-dimensional 
scaling is indicated. 


In a recent paper, Householder and Young (1) relate Thurstone’s 
psychophysical scale to the theory of one-parameter continuous groups 
of transformations in the following way. Suppose a series of stimuli, 
varying with respect to a single attribute whose measure is 2, is pre- 
sented in pairs and repeated judgments required as to the relative 
magnitudes of x in the members of these pairs. If the presentation is 
symmetric so that no bias can be present, then given any two stimuli 


of measure x and zx, there will be a unique p(x, x) which is the ratio 
of the number of judgments “xz > x” to the total number of judgments 


relative to and x. Furthermore if x > «, then p(z, x) > p(z, x), and 
-4x,2) = Y. Hence there is defined a function f(z, p) such that 


a= f(x, p) (1) 


identically for p = p(x, x), and this function defines a one-parameter 


continuous group of transformations of x into x. Hence by applying 
a well-known theorem we see that it is always possible to determine 
functions 


y=y(zx), b=b(p) (2) 
in such a way that the relation (1) is equivalent to 
y=y+b, (3) 
where we understand that y signifies y(z). 
331 
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This is essentially Thurstone’s psychophysical scale in the case 
where the dispersion of the “discriminal process” is the same for all 
stimuli, and where these discriminal processes are uncorrelated. More- 
over, b is defined by Thurstone as a function of p by means of the 
normal probability integral with o = 1 and is \/2 times that limit of 
the integral for which this integral takes the value p. In the more 
general formulation, however, Thurstone gives, not the scale (3), but 
one satisfying the relation 





Z—-Z=Cyv0e+2reat+c°. (4) 


Here o = «(Z), and o(Z) is the dispersion of the discriminal process, 
supposed to vary from stimulus to stimulus, r is the correlation, and 


C is the same function of p as b is in (3), except for the factor 2. 
Evidently this allows greater latitude, for besides the values of Z 
associated with each stimulus there is the function «(Z) (or the 
functional values corresponding to each Z included among the stimuli) 
and also the function 7(Z, Z), all to be determined from the data or 
by making special assumptions. Nevertheless, (4) is mathematically 
equivalent to (3) if it is understood that choice of the parameter b 
may be allowed in other ways than that described above in terms of 
the normal probability integral. By “equivalent” is meant here that a 
transformation y = y(Z), b = b(c) must exist such that (4) is trans- 
formed thereby into (38) ; it is not true, obviously, that y and Z define 
the same scale. In the paper (1) referred to above this point was not 
made explicitly. 

It is partly for this reason that the foregoing comments are made, 
but partly also to point out the variety of possible assumptions on 
which a psychophysical scale can be based. Empiricaliy, that based on 
the normal probability curve may be-found, in special cases or in all 
cases, to be the best. A priori, any distribution may be assumed for 
defining b or c, or the approach may be quite different. If, for example, 
the physical scale, x, can be measured, then the observed values of p 
corresponding to each pair of stimuli x; and x; can be plotted in three 
dimensions. These are taken as the values p(2;, 2;) of the function 
p, where p(x;, x;) +p(x;,x:) = 1, and an analytic surface can be 
passed through these points. Any assumptions that seem reasonable 
can be imposed to restrict in advance the form of the surface, but once 


the surface p(z, x) has been determined the equation 
p(x, x) =p (5) 


can be solved for x as a function of x and p to obtain an equation of 
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the form (1). Then a pair of differential equations gives the trans- 
formation to the form (3). 

It is not, in fact, necessary that the x-scale shall be known. The 
observed frequencies determine the ordering of the stimuli, finite in 
number, and they can be assigned x-values similarly ordered but oth- 
erwise arbitrary. However, in this case, the form to be assumed for 
the p-surface would seem to be without significance. In neither case 
do we wish to be interpreted as recommending the procedure outlined ; 
we wish only to illustrate the variety of assumptions possible. 

The extension to multi-dimensional scaling is fairly immediate. 
Let the stimuli be sa (a=1,---, v), where the symbol 8. is merely a 
name and not a number. (Ultimately it may be replaced by a vector 
in a space of a suitable number of dimensions.) Then from these 
stimuli can be formed »(yv + 1)/2 pairs (sa, 8g), including the y cases 
where a = f/. Each such stimulus pair constitutes a compound stimu- 
lus x; [¢=1,---, »(» + 1) /2], and each z; is to be presented with each 
x; and the percentage of judgments x; > x; ascertained. Now the «; 
is taken to represent a “distance.” The x-scale has obviously a zero 
corresponding to the pairs of identical stimulus objects. Also every 
x is taken as positive and the distribution is thus necessarily skewed 
— at least near the origin. Hence the normal law must be replaced by 
another — perhaps a I’-distribution of some sort. This is a statistical 
and a psychological problem which we pass over here. But whatever 
choice is made, some function b(p) can be determined so that (3) 
holds. Then to each pair (8a, Sg) will be assigned a distance. The tech- 
nique for analyzing a set of points whose mutual distances are known 
has already been described (2). 
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